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ABSTRACT 

The longitudinal study was Phase 2 of a study 
designed to determine the relationship between selection techniques 
(used by the State of Colorado Civil Service Commission and the 
Career Service Authority of the city and county of Denver) and 
on-the-job performance in specified job classifications for personnel 
classified as (1) Negro, (2) Spanish-surname, or (3) White- Jobs 
included in the longitudinal analysis were (1) Hospital Attendant at 
Denver General Hospital; (2) Intermediate Clerk Typist; (3) Clerk 
Stenographer, Intermediate Clerk Stenographer, and Senior Clerk 
Stenographer; (4) Clerk Typist, Senior Clerk Typist, and Dictation 
Machine Operator (all in various State office settings) ; and (5) 
Resident Supervisor Trainee at Lookout Mountain School for Boys. 
Results are presented in graphical and statistical form and indicate 
no difference in job performance among the 3 ethnic groups. Also, on 
the paper-and- pencil tests used, the White groups scored consistently 
higher but mean oral interview ratings were comparable. In most cases 
where differences were found, there was considerable overlapping of 
score distributions. Evidence from the study indicates that the 
relationship between predictor variable and job performance varies 
from one ethnic group to another. A related document is RC 004 239. 
(DK) 
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INTRODUCTION 



This report contains the findings of the second of two phases 
of a project designed to determine the relationship between selection 
techniques used by the State of Colorado Civil Service Conmission 
and the Career Service Authority of the City and County of Denver 
and on-the-job performance in specified job classifications when 
personnel are classified by (1) Negro, (2) Spanish-surname. and (3) 

White groups. The two phases of the project involved (1) the cross 
sectional testing of present employees and the concurrent assessment 
of their job performance, and (2) the longitudinal testing of job 
applicants with a subsequent follow-up on their on-the-job performance. 
The jobs involved in the longitudinal analysis included (1) Hospital 
Attendant at Denver General Hospital, (2) Intermediate Clerk Typist, 

(3) Clerk Stenographer, Intermediate Clerk Stenographer and Senior 
Clerk Stenographer, (4) Clerk Typist, Senior Clerk Typist and Dictation 
Machine Operator (all in various State office settings), and (5) 

Resident Supervisor Trainee at Lookout Mountain School for Boys. 

The cross sectional phase was considered a p»*eliminary phase of 
the project since (1) test scores were used in making the selection 
decisions to employ present personnel, thereby yielding a contaminated 
sample; (2) tests were administered to present employees on a voluntary 
basis and all employees were not included; (3) several tests were 
administered at a point in time other than that of application, making 
it necessary to assume that presently-obtained scores are comparable 
to those which would have been obtained at the time of application; 

(4) criterion ratings of job performances may have been subtly influenced 
by differential amounts of time on the job; and (5) some of the variation 
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in job performance may have been produced by variations in training 
procedures to which incumbents were exposed. The longitudinal phase 
of the project was undertaken to rectify some of these shortcomings. 

Although the nature of the project was described in detail in 
the report of findings from the cross sectional phase, the background 
for the project and the proposal on which it was based are repeated 
in the following paragraphs to allow this report to be considered 
independently from the first report.^ 

Background 

When the Tower Amendment to the Civil Rights Act was passed, the 

legality of using employment tests was noted, but the responsibility 

of employers to demonstrate that their selection tests would not 

result in unfair discrimination associated with race, color, religion, 

sex or national origin was clearly implied: 

It shall not be... an unlawful employment practice for an 
employer to give and act upon the results of any profes- 
sionally developed ability test provided that such test... 
is not... used to discriminate because of race, color, 
religion, sex, or national origin. 

Civil Rights Act, 1964, Section 703(h) 
Fulfillment of the responsibility for demonstrating that his 
tests are not unfairly discriminatory reguires that the employer know 
(1) how well individuals from various subgroups of the population can 
perform the job in guestion, (2) how well individuals from various 



Neidt, Charles 0. Report on Differential Predictive Validity of 
Specified Selection Technigues within Designated Subgroups of Applicants 
for Civil Service Positions , Human Factors Research Laboratory, Colo- 
rado State University, Fort Collins, Colorado, May 22, 1968. 
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subgroups of the population perform on the tests being used, and (3) 
the extent to which performance on the tests is predictive of 
performance on the job, both within and among the subgroups. Insight 
into the first issue can be gained only if individuals from all sub- 
groups concerned are given the opportunity to perform the job. 

Insight into the second issue is readily gained by an examination of 
the performance on tests administered to members of the subgroups. 
Insight into the third issue can be gained only when test scores are 
correlated with job performance within subgroups— a condition predicated 
on the availability of job performance measures for reasonable nuinbers 
of subgroup members having held the job for an adequate length of 
time. The hi ah interdependence of the first and third issues has made 
test discrimination research unfeasible in those situations where job 
applicants have been restricted or where the incumbents have been 
selected on the basis of test results. 

General Methodology 

The project reported herein was an outgrowth of a contract between 

the Equal Employment Opportunity Commission and the Colorado Civil Rights 

Commission. In the original application for financial assistance, 

2 

the general objective of the project was stated as follows: 

To investigate the conformity of the testing and hiring 
procedures used by governmental agencies in Colorado with 
the EEOC Guidelines on Employment Testing . 

The area in which intensive investigation is proposed is: 
Establishing whether or not the performance on the tests used 
in the selection of employees is related to on-the-job perfor- 
mance. If a relationship is found to exist, then to determine 
if the tests improperly discriminate against any ethnic group. 



2 

Application for Financial Assistance, January 24, 1967, submitted 
by Colorado Civil Rights Commission, 306 State Services Building, 

1525 Sherman Street, Denver, Colorado. 

er|c 



Upon approval of its application for financial assistance, the 

Colorado Civil Rights Commission then subcontracted with Colorado 

State University to collect and analyze appropriate data and report 
3 

the results. In the subcontract with Colorado State University, the 
following steps were identified: 

Step 1. Job analysis to determine job activities and character- 
istics considered essential for the successful performance of each job. 

Step 2. Identification of criteria of successful performance 
for each job including supervisory ratings, supervisory rankings, 
training scores, personnel criteria, and turnover. 

Step 3. Correlation of existing test data with performance 
criteria. 

Step 4. Identification of additional testing devices for adminis 
cration to present employees. These devices were to include both 
verbal and low verbal tests, as well as personal history inventory 
information. It was anticipated that at least 200 present employees 
would be administered the tests. 

Step 5. Validation of additional devices through the computation 
of means and standard deviations for specific ethnic groups as well as 
the computations of coefficients of correlation with one or more 
criteria within each ethnic group. 

Step 6. Longitudinal cross validation of selection techniques 
with an uncontaminated sample. On the basis of evidence from the 
two approaches, cross sectional and longitudinal, a specific set of 
recommendations for reducing possible discrimination through the use 
of tests in employment by governmental agencies in Colorado was to 
be developed. 

As indicated previously, the results of the cross sectional phase 
(Steps 1 through 6) of the project have been reported earlier. The 
results of the longitudinal phase (Step 7) of the project are reported 
herein. 



Differential Predictive Validity of Specified Selection Techni- 
ues Within Designated Subgroups of Applicants , Proposal to the Colorado 
ivil Rights Commission, by Colorado State University, May 15, 1967. 
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LONGITUDINAL DATA COLLECTION 

Successful implementation of the longitudinal phase of the 
present project required a procedure for identifying the ethnic group 
membership of each applicant as early in the selection process as 
possible. Initially, some consideration was given to conducting a 
preliminary screening interview with each applicant at which time the 
applicants would have been classified by ethnic group, but xhis was 
rejected as impractical. Instead, a form was designed on which each 
applicant was asked to indicate his ethnic group membership along 
with his age, sex and education. The form was accompanied by an 
explanation of the project and mild encouragement to participate in it 
as follows: 



The tests you are about to take are part of a study being 
conducted by the Equal Employment Opportunity Commission, the 
Colorado Civil Rights Commission and Colorado State Univer- 
sity. The purpose of this project is to find out how well 
different groups score on employment tests regardless of race, 
creed, or color. We are therefore asking you to indicate your 
ethnic group on the attached sheet. This information will 
be used for research purposes only. These tests will not 
affect your ranking for this job. Although you are not required 
to take these tests or to give your ethnic background, you 
are urged to do so because by taking them you will be helping 
to eliminate discrimination in employment. 

James F. Reynolds, Director Charles 0. Neidt, Director 

Colorado Civil Rights Commission Human Factors Research Laboratory 

Colorado State University 



This form was administered along with the tests at the initial contact 
between the applicant and the employing agency. Throughout the year 
during which the data were collected, only one individual refused to 
indicate his ethnic group membership. In addition, no unfavorable 




6 



coments were noted when the forms were distributed. Neither were there 
protests of any type lodged about the information with any civil rights 
agencies in the state. Apparently, asking applicants to state their 
ethnic group membership created no serious negative reactions. 

In addition to obtaining ethnic group membership from all appli- 
cants, hospital attendant applicants, intermediate clerk typist appli- 
cants and resident supervisor trainee applicants also were administered 
a battery of three low verbal tests used in the cross sectional phase 
of the project. These tests were as follows. 

Matrices Test ; The Matrices Test is a 55-vtem test of general 
mental ability constructed by the Colorado State University Human Factors 
Research Laboratory requiring subjects to select one of five symbols 
which will complete a “matrix" as follows: 






The test is in its third experimental edition been a<kninistered 

to a variety of ethnic groups in several settings. Retest reliability 
coefficients of .89 to .95 have been reported based on intervals of 
three weeks between administrations. 

Symbol Checking, X-0, $-^ Tests : To assess division of attention 

and visual discrimination under highly timed conditions, the symbol 
checking tests of the Low Verbal Series of the CSU Human Factors Research 
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Laboratory was used. This test requires four minutes for the X-0 
section and two minutes for the $-i section. Odd-even reliabilities 
for the tests were found to be .94, .92 and .96 for the combined 

scores based on the previously mentioned sample. In this test the 
examinee is required to contrast groups of symbols for similarity and 
difference. The X-0 section contains 60 items and the $-4 section 
contains 30 items. 

Visual Memory: The visual memory test was also constructed 

specifically for the present project. This test involves looking at 
a group of twenty abstract designs for 30 seconds and then selecting 
those which were seen from among 72 symbols appearing in a booklet. 
Reliabilities of .92 and .87 were obtained for this test with the same 
sample as was mentioned previously. Abstract symbols rather than 
identifiable objects are included to reduce the influence of culture. 

The total testing time for the three low verbal tests was 28 
minutes. The hospital attendant applicants also were administered the 
SRA Non-Verbal Form, Form AH, which requires 10 minutes. The clerical 
applicants and the resident supervisor trainee applicants were given the 
written tests ordinarily used in the State Civil Service selection 
procedure. None of the test scores was used for the selection of 
hospital attendants, but the regular weighting and combining procedures 
followed by the Colorado Civil Service Commission were used for select- 
ing all clerical personnel and resident supervisor trainees. 

The low verbal tests were administered to groups of five to 
thirty applicants at each testing session by the psychometrists of the 
two agencies. Tests were distributed to the applicants in large 
envelopes and replaced in the envelopes as soon as each test in the 
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battery was finished. The completed tests were then returned to Colorado 
State University in the envelopes for scoring ?nd analysis. In most 
instances the low verbal tests were never handled by agency personnel 
in any way, thereby more nearly assuring freedom from contamination. 

When the tests were received at Colorado State University they 
were scored and used as a basis for initiating the following record card: 



Name 




No. 




Age Ethnic Group 


Educa tion 


Employment Agency 


Test #1 X-0 $-4 


Total 






Test #3 Visual Memory 








Test #6 Matrices 


SRA Nonverbal 






Hired: Yes No 









Copies of completed applications and interview ratings were then 
forwarded to CSU by each agency. For Denver General Hospital these 
materials were followed by monthly summaries of hiring actions and 
termination reports. In this manner it was possible to maintain a sys- 
tematic accumulation of applicant data throughout the year. 

During March and April, criterion data were obtained from the 
personnel shield of each person who had been employed during the previous 
nine months. The first set of criterion data collected consisted of 
the 90-day performance evaluations completed for the individual by his 
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supervisor. Since so many employees were rated "standard,” however, 
it was necessary to identify additional criteria of job performance 
for the study. 

For employees of Denver General Hospital, the name of each person 
was typed on a small card and the cards were given to the Assistant 
Director of Nursing and the Director of Central Supply who met with the 
supervisors of the employees to arrange the cards according to the 
following directions: 

You have been given a stack of cards with the names of the 
(job title) you supervise printed on them. This stack of 
cards is to be used in indicating how well each (job title) 
performs his or her job. You are to stack the cards in 
order from best to poorest worker. In stacking the cards, 
consider how well the person does his job and how much he 
does. In other words, put your best worker first and your 
poorest worker last. Two workers cannot tie— they must 
appear in rank oraer according to your best judgment. 

After the initial ranking the cards were re-sorted on the basis 

of ability to perform the job duties, without regard to performance. 

The ranks were then converted to five-point scales as follows: 

5 - upper 10% 

4 - next 20% 

3 - middle 40% 

2 - next 20% 

1 - lower 10% 

For all individuals employed through the State Civil Service, the 
name of each employee was typed on a performance evaluation sheet and 
sent to the supervisor of each individual through the local agency 
personnel representative with a memorandum of instructions accompanying 
the sheets. Employees were rated on four performance characteristics 




as follows: 
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Area 1 ABILITY TO LEARN: Consider speed in grasping explanations and retaining them. 



] 2 3 4 5 6 7^ 

Very slow, Reguires a great Average Good ability to learn Exceptionally 
Poor memory deal of instruction instruction and retain fast, seldom 

reguired information forgets 



Area 2 QUANTITY OF WORK: Consider volume of work produced. Disregard errors. 



1 

Very small 
amount 



2 3 4 

Below average Reasonable 

amount amount 



5 6 7 

Good volume Unusually 

large amount 



Area 3 QUALITY OF WORK: Consider neatness, accuracy, disregard guantity. 



1 

Too many 
errors , 
unacceptable 



2 3 4 

Often unacceptable. Acceptable 
freguent errors 



5 6 7 

Usually neat. Accurate and 
occasional errors neat, very 

few errors 



Area 4 KNOWLEDGE OF WORK: Consider knowledge through education, training, 

experience, etc. 



1 

Inadeguate 

knowledge 



2 3 4 

Reguires consider- Knows 
able help essentials 



5 6 7 

Performs without Well informed 

assistance in all phases 



Two different systems of obtaining performance evaluation were 
necessary since many of the supervisors in the State agencies supervised 
only one participant and card stacking or ranking would have been 
inappropriate. 

To assess the reliability of the two sets of performance criterion 



measures, coefficients of stability and of equivalence were computed. 

These were found to be as follows: 

Ranking 



Group 

Supervisors of 35 psychiatric 
technicians 

Supervisors of 57 food service 
workers 

Nursing supervisors for 32 aides 
Nursing supervisors for 57 aides 



Situation 



3-week lapse 

2-week lapse 
2-week lapse 
2-week lapse 



Coefficient 



.87 

.89 

.92 

.86 
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Rati ng 



Group 

Supervisors of 50 clerical personnel 

Quantity and Quality 

Quantity and Ability 

Quantity and Knowledge 

Quality and Ability 

Quality and Knowledge 

Ability and Knowledge 



Situation 


Coeffici 


2-week lapse 


.86 


One administration 


.72 


II II 


.75 


II II 


.71 


II II 


.72 


II II 


.78 


II II 


.71 



These coefficients parallel those obtained in Phase I of the 



present project. In general, the reliability of the criterion measures 
was considered satisfactory for purpose of the present study. 

As information on each applicant was accumulated, it was filed 



in a manila folder for each individual. In some instances only the test 
data were avail ablej in other instances test data and application infor- 



mation only were available; in still other instances, test data, 
application information, interview ratings, hiring dates and various 
performance data were accumulated in the folder. 

To reflect the sequential nature of the steps in the selection 



process used by the two agencies, a chart of the employment system was 
developed. This chart was designed to indicate all stages of survival 
and attrition in the hiring processes and to classify the progress 
through the system made by each applicant. These charts form the graphs 

appearing in the Results section. 

Whereas all applicants for the position of hospital attendant 
were tested throughout the longitudinal phase of the project (March, 

1968 to January, 1969), the clerical and resident supervisor trainee 
applicants were tested on an irregular basis. This resulted from a 
shortage of psychometrists and from time limitations. Data were 
collected throughout the year from about 75% of the applicants for 
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clerical and resident supervisor trainee positions. 

At the close of the project (April 1, 1969), each individual who 
had participated in any phase was classified within the system. Alto- 
gether, 307 individuals comprised the applicant sample for the Career 
Service Authority of the City and County of Denver and 421 for the 
State of Colorado Civil Service Commission. Of these, 73 were eventually 
employed by Denver General Hospital and 101 by State agencies. 

All data were then coded on data processing worksheets and key- 
punched and verified. The two code manuals are shown in the Appendix. 
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RESULTS 

Since the present project involved data from two separate employ- 
ing agencies, the results are presented separately for each agency. 

The data from the Career Service Authority of the City and County of 
Denver are discussed in the first section of this chapter and those 
from the State Civil Service are discussed in the second section. 

CAREER SERVICE AUTHORITY - DENVER GENERAL HOSPITAL 

Four types of results were obtained from analyses of data from 
the Career Service Authority of the City and County of Denver. These 
results are as follows: 

1. Selection Stage and Ethnic Group Data 

2. Performance Data by Ethnic Group for Those Employed 

3. Correlations Between Selection Characteristics and Performance 
Data by Ethnic Group 

4. Frequency Distributions and Performance Data by Ethnic Group 
Selection Stage by Ethnic Group 

In Graph 1 are shown the numbers and percentages of applicants by 
ethnic group membership for the various selection stages defined by the 
Career Service Authority of the City and County of Denver. Of the 307 
applicants who completed the test battery throughout the year, 73 or 24% 
were ultimately employed. Of those employed, 23% were Negro, 26% were 
White and 20% were Spanish-surname. Detailed examination of the stages 
at which applicants were eliminated indicates that a larger proportion 
of Spanish-surname individuals than would be expected on the basis of 
chance failed to appear for interview at Career Service, did not qualify 
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Graph 1. Attritiorj Survival by Selection Stage and Ethnic Group 
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or were not certified. In additior , a slightly higher percentage than 
chance expectancy did not appear at the hospital for interview. 

Conversely, relatively fewer than expectancy were eliminated because of 
failure to return to the hospital for a second interview after not 
having been hired on the basis of the first interview. 

In contrast to the Spanish-sumame applicants, relatively fewer 
Negro applicants were not certified and were elirninated because of failure 
to appear for interview at the hospital. (Sta'^ed in opposite terms from 
the graph entries, more were certified and more appeared at the hospital 
for interview.) However, proportionately more Negroes did not return 
for a second interview after not being hired on the basis of the first 
interview than would be expected, and more were rejected after two inter- 
views than would be expected in terms of the relative proportions of 

Negroes who were tested initially. 

For White applicants, a larger proportion withdrew before Career 
Service interviews, did not Qualify or did not pass, and did not report 
for work than would be expected. Relatively fewer Whites than expected 
failed to appear for Career Service interviewing, did not appear tor the 
initial or second interview at the hospital, or were still on the list at 
the close of the study. 

It should be noted that the numbers involved in the "Causes of 
Elimination" stages of the selection process (right hand side of Graph 1) 
are very small and that results can be considered as indicative of trends 
only. When the small numbers are taken into account, however, it seems 
reasonable to conclude that there is no evidence of deliberate discrimina- 
tion, but that the selection procedures may be more appropriate for 
Whites than for either minority group. Specifically, the time delays 
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between stages seem io have an adverse effect on Span1sh*sumame personnel, 
and the interviews may affect the Negroes adversely. The latter is 
particularly well illustrated in the Negro percentage (442?) of the 
applicants who did not appear for a second interview at Denver General 
Hospital. It is hypothesized that the Negroes may have been discouraged 
by not being offered a job on the basis of first interview and therefore 
did not return for the second interview, even though they were entitled 
to two such interviews. The implications of these findings will be 
discussed in detail in a later chapter. 

Although all the graphs describing characteristics of applicants 
by selection stage and by ethnic group contain reference to the perfor- 
mance of those employed (last line of graph), this information is consid- 
ered in much greater detail in a subsequent section of this chapter. 

No specific interpretation will be made of the performance results in 
this section. Rather, the performance groupings are presented here for 
general information only and will be discussed in detail later. 

In Graph 2 the ages of applicants by selection stage and ethnic 
group membership are shown. The F-values shown beside each selection 
stage represent indices of the significance of the difference among the 
three mean age values at each stage. In all instances, the differences 
amiong the three mean ages are not statistically significant. 

In reviewing the various conditions for elimination from further 
consideration, a younger mean age for those failing to appear at the 
hospital for initial interview can be noted. 

Differences among educational levels of the three ethnic groups 
by selection stage are shown in Graph 3. Whereas the White applicants 
in the "Tested" group and in most ether stages reflected a higher 
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Graph 3. Education by Selection Stage and Ethnic Group 
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educational level, sofne exceptions can be noted. The Whites not 
appearing for interview at Career Service, not hired on the basis of 
the first interview and not appearing for the second interview, and 
still on the list had completed fewer years of schooling, on the 
average, than members of the two minority groups. 

It should be noted that the educational requirement for the 
hospital attendant position was eliminated half-way through the experi- 
mental year, thus making the educational background of the applicants 
more variable during the later months of the project. An analysis of 
the mean educational level by month reflects a drop of one and one-half 
years for the Spanish-surname mean level and of one year for the Negroes 
and Whites. As will be seen later, the elimination of the educational 
requirement apparently had no adverse effect on the performance of 
those hired. 

In Graphs 4 through 9 are shown the mean score on various selection 
tests by selection stage and ethnic group. It will be recalled that the 
test scores were not used in any manner for selection purposes. Neverthe- 
less, the applicants ultimately selected within ethnic groups almost 
universally had higher scores than the original applicant pool. In 
addition, the differences among the mean scores for the three ethnic 
groups tended to be smaller for those hired than the difference among 
the groups originally tested. This is indicated by the decrease in size 
of F- values between the tested comparisons and the hired comparisons. 
Apparently the interview ratings and the selection procedure itself 
yielded more homogeneous groups as selection proceeded. Detailed comment 
about the use of tests will be made later, but suffice it to say at this 
time that the use of tests would have eliminated many of those from 
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♦Significant at .05 level or beyond 

Graph 7. SRA Non Verbal Score by Selection Stage and Ethnic Group 
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♦Significant at .05 level or beyond 

Graph 8. Visual Memory Score by Selection Stage and Ethnic Group 



25 



Matrices Score by Selection Staqe and Ethnic Group 



INTERVIEireD* 

F = 8.869 
(2.213) 



LISTED* 

F = 7.459 
(2.182) 



CERTIFIED 

F = 10.169 
(2.145) 



HIRED* 

F = 6.731 
(2.70) 



X 

N 



1 TESTED* 


r* 


w 


s 


T 


I 22.7 

liD 


30.2 

140 

■MV 


24.1 

90 


26.6 

304 



F= 16.567 
(2.301) 



N 


w 


S 


T 


23.3 

55 


29.7 

101 


24.1 

60 


26.6 

216 



1 N 


w 


s 


f 


I 24.3 

\ 49 


30.1 

84 


24.4 

52 


27.0 

185 



N 


W 


S 


T 


24.4 

7 


34.1 

14 


28.0 

4 


30.4 

_25. 


18.7 

12 


30.0 

25 


23.6 

26 


25.2 

63 




N 


W 


s 


T 


26.0 

1 


40.5 

6 


25.6 

5 


33.1 

12 


13.4 

5 


20.^ 

11 


17.3 

3 


18.4 

19 



Withdrew 

Did Not Appear for 
Interview at C.S. 



Did Not Qualify 



Did Not Pass 



1 ” 


w 


s 


T 


I 22.9 

lL 


30.3 

67 


22.6 

39 


26.1 

148 



N 


W 


S 


T 


32.7 

7 


29.6 

17 


295 

13 


30.2 

37 



Not Certified 



N 


w 


s 


^ ! 


24.0 

17 


31.0 

37 


21.1 

19 


26.71 
73 1 



N 


W 


S 


T 


28.3 


32.0 


?5.5 


29.0 


4 


10 


8 


22 


23.0 


33.8 


2a5 


29.3 


4 


6 


2 


12 


25.0 


23.6 


313 


25.4 


7 


6 


3 


16 


23.0 


27.2 


15.5 


22.4 


6 


5 


4 


15 


11.0 


22.0 


20.7 


16.7 


4 


2 


3 


9 



Eliminated - DNA at 
Hospital for Interview 

Voluntarily Refused 
After Certification 

Eliminated - Did Not Hire 
1st and DNA 2nd 

Rejected - DNH 1st and 
DNH 2nd 

Still On List 



N 


w 


S 


T 


27.0 

1 


25.5 

6 


22.0 

1 


25.3 

8 



Hired - Did Not Report 







High 


Standard 


Low 1 


N' 


w 


s 


T 


N 


w 


s 


T 


N 


w 


S 


T 1 


27.0 


35.3 


32.7 


32.0 


17.5 


32.1 


19.4 


24.2 


20.3 


34.5 


20.0 


27.3 ! 


3 


4 


3 


10 


4 


8 


8 


20 


3 


8 







:~(i. 



Would J 


Leihiri 


p 1 


N 


W 


S 


— 


22.0 

1 


38.8 

4 







Than 90 Days 
Would Not Rehire 



N 



W 



23.6 

7 



13.0 

2 



T 



23 j6 
14 



♦Significant at .05 level or beyond 



o 

ERLC 



Graph 9. Matrices Score by Selection Stage and Ethnic Group 



further consideration who were eliminated by the selection process. 

Of particular note is the Science Research Associates Non Verbal 
Test result shown in Graph 7. Prior to the present project, a cutting 
score of 30 had been used to eliminate applicants from further considera- 
tion. It will be noted that only two groups— Negro-Did Not Pass and Negro- 
Still On List— obtained mean scores below 30. 

In general, the visual memory test and the X-0 perceptual discrimi- 
nation tests yielded the most similar distributions of scores among the 
three ethnic groups. Those tests involving abstract relations tended 
to yield the greatest differences (Matrices and SRA Non Verbal). 

In those instances where significantly different means among the 
tested groups were noted, the White group tended to score highest, the 
Spanish-sumame group next, and the Negro group lowest. When those ulti- 
mately hired were compared, some reversals between the relative positions 
of the two minority groups can be noted. 

In summary, consistent differences in test score among ethnic 
groups did appear at most selection stages, although the applicants 
tended to become more homogeneous as selection proceeded. This suggests 
that the test results tended to corroborate the interview ratings and 
the selection process. 

In Graph 10 are shown the total interview ratings assigned the 
applicants by ethnic group. It can be noted that the three ethnic groups 
tended to receive more nearly similar interview ratings than test scores 
( non-si gnifi can c F-values). It will also be noted that those hired had 
considerably higher interview ratings than those eliminated. This trend 
may be an artifact, however, in that the interview ratings entered into 
the selection procedure itself and yielded the observed results. Of 
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particular importance to the present project is the similarity of the 
interview ratings assigned to the 138 applicants. The F- value of 1.321 
is not significant and can be interpreted to mean that differences 
among the three ethnic groups in interview ratings are well within chance 
expectation. 

It is interesting to note that the interview ratings assigned the 
Negro group tended to be as high as or higher than those of the White 
group except in the hired category. The six Whites who did not report 
for work after having been offered a position had unusually high inter- 
view ratings, however, and removal of these values from the distribution 
lowered the mean value of the remaining individuals considerably. 

In Graph 11 the sex of applicants by selection stage and ethnic 
group is shown. Inspection of this graph reveals a tendency for Negro 
women and White men to be emoloyed as hospital attendants. Those 
eliminated because of not being certified tended to be male, however. 
Spanish-surname personnel maintained relatively constant proportions 
between sexes throughout the selection process. 

A relatively higher proportion of married Spanish-surname personnel 
than White or Negro personnel in the applicant group is reflected in 
Graph 12. The lower proportions of White married applicants suggests 
that the majority of this classification may be seeking employment at 
higher levels in the job hierarchy than tlie job of hospital attendant. 

A relatively small but constant percentage of veteran applicants 
by ethnic group is shown in Graph 13. It is interesting to note that 
the performance of these individuals hired as hospital attendants was 
not impressive. Of four Whites hired, one did not report and three 
worked less than 90 days. The two Spanish-surname personnel were rated 
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Graph 12. Marital Status by Selection Stage and Ethnic Group 
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Graph 13. Veteran Status (Yes) by Selection Stage and Ethnic Group 
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Graph 14. Foreign Language (Yes) by Selection Stage and Ethnic Group 
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Graph 15. Presently Employed (Yes) by Selection Stage and Ethnic Group 
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Graph 17. Money Earned on Last Job by Selection Stage and Ethnic Group 
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Graph 18. Last Job Unskilled by Selection Stage and Ethnic Group 
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Graph 19. Money Earned on Next to Last Job by Selection Stage and Ethnic Group 
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as “low" performance. One Negro worked less than 90 days and qualified 
as “would rehire" and the other worked more than 90 days but was rated 
“low." 

In Graph 14 are shown the data relative to foreign languages 
spoken by applicants. As might be expected, Spanish-surname personnel 
listed ability to speak a foreign language more frequently than the other 
two groups, although a surprisingly high proportion in each of the other 
two groups listed this characteristic. Apparently, ability to speak a 
foreign language is unrelated to ultimate performance on this job, however. 

In Graph 15 the percentage of applicants presently employed is 
shown by selection stage and ethnic group. Highest proportion of 
presently employed was among the Negroes. 

In Graph 16 are shown the mean months on last job by selection 
stage and ethnic group. Although differences among the groups were not 
statistically significant, the White group had held the previous job for 
a shorter time, on the average, than trie other two groups. 

Differences in money earned (monthly) on last job by ethnic group 
and selection stage are shown in Graph 17. In the original job applicant 
group (tested) the Whites had the highest mean monthly salary, although 
the three hired groups did not differ in this respect. 

The percentage of individuals listing an unskilled job as their 
last employment is shown in Graph 18. Although the numbers are relatively 
small, the two minority groups had higher percentages in this category 
than the White group. 

Money earned on the next to last job is shown by ethnic group and 
selection stage in Graph 19. As in Graph 17, the Whites in the tested 
group listed the highest mean monthly salary. For those hired, however. 
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the Spanish-surname personnel listed the highest salary. This suggests 
that the Negroes In the hired group were moving upward In salary whereas 
the other two groups were moving downward In this respect. 

Health related experience of applicants Is shown In Graph 20. 

Whereas the small numbers make Interpretation of these data difficult. 

It Is Interesting to note that the preponderance of Spanish-surname 
personnel who had had health related experience rated standard or above 
(7 of 8) and all worked more than 90 days. 

In Graphs 21 and 22 the percentages of applicants who had lived In 
Denver less than 6 months and more than 36 months are shown. No particu- 
lar pattern Is apparent for this characteristic. 

The number and proportion of applicants having violated the law 
(as listed on their application form) are shown In Graph 23. Here It can 
be seen that the two minority groups listed this characteristic relatively 
more frequently than did Whites. 

In Graphs 24, 25 and 26 are shown the bases of application for the 
three ethnic groups. Differences In source among the three groups are 
noteworthy. Whereas newspaper was listed by 38% of Whites as the basis 
for application, only 11% of the Negroes and 18% of the Spanish-surname 
personnel Indicated this source as the basis for their applications. 
Conversely, friend was listed least often by Whites. It should be noted 
that the application form listed other alternatives than the three sources 
shown In the graphs, but these were most frequently designated by this 
population. These graphs suggest that different recruiting techniques 
will be appr-oprlate for different ethnic groups In this population of 
job applicants. 
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Graph 20. Health Related Experience (Yes) by Selection Stage and Ethnic Group 
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Length of Time in Denver by Selection Stage and Ethnic Group 

(Less Than 6 months) 
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Graph 21. Length of time in Denver by Selection Stage and Ethnic Group 

(Less Than 6 Months) 
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(More Than 36 Months) 
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Graph 22. Length of Time in Denver by Selection Stage and Ethnic Group 

(More Than 36 Months) 
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Graph 24. Basis of Application (Friend) by Selection Stage and Ethnic Group 
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Basis of Application (Notice Card) by Selection Stage 

and Ethnic Group 
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Graph 25. Basis of Application (Notice Card) by Selection Stage and Ethnic Group 
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Basis of Apolication (Newspaper) by Selection Stage 

and Ethnic Group 
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Graph 26 . Basis of Application (Newspaper) by Selection Stage and Ethnic Group 
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A summary of the characteristics of individuals hired after the 
first or after the second interview in contrast to those not hired 
is shown in Table 1. Although the number of individuals hired on the 
second interview is small for all groups, several differences can be 
noted. In part, these differences could be the result of the selection 
process, or they could be the result of a change in the composition of 
the group which returned for the second interview. In other words, 
those who did not return may have been considerably different from 
those who did, thereby forcing differences in characteristics of those 
hired. Interestingly, the Whites hired on the second interview had 
higher interview ratings than those hired on the first interview, although 
they obtained consistently lower test scores. 

In summary of the graphic representation of the selection process 
at the Career Service Authority of the City and County of Denver, some 
evidence was noted of a differential effect of the selection process on 
the three ethnic groups. Whereas Whites were not adversely affected by 
time delays or return interviews, the minority groups were. It was 
further noted that the selection process tended to make the applicants 
more homogeneous with respect to characteristics measured by tests not 
involved in the selection decisions. In addition, it was also noted that 
Whites tended to score higher than Spanish-surname personnel and Negroes 
on most of the tests administered at the time of application. 

In contrast to the test scores, interview ratings given to the 
three groups were similar. Background characteristics of the three 
groups suggested that the population of Negro applicants may contain more 
individuals with high job performance potential than the other two groups 
in terms of percentage presently employed, interview ratings, increasingly 




48 



Table 1 

Characteristics of Individuals Hired on First Interview, 
Second Interview and Those Not Hired 



Characteristic 



Aqe 


First 
Second 
Not Hired 


Education 


First 
Second 
Not Hired 


Percent Female 


First 
Second 
Not Hired 


X-0 Score 


First 
Second 
Not Hired 


%-i Score 


First 
Second 
Not Hired 


X-0 %-i Total 


First 
Second 
Not Hired 


SRA 


First 
Second 
Not Hired 


Visual Memory 


First 
Second 
Not Hired 


Matri ces 


First 
Second 
Not Hired 


Total Interview 


First 
Second 
Not Hired 


Ability 


First 

Second 


Performance 


First 

Second 



i 



Negro 


White 


Spani sh 
Surname 


Total 


28.2 (14) 


24.7 (32) 


31.5 (16) 


27.2 (62) 


43.0 (3) 


36.8 (5) 


35.7 (3) 


38.2 (11) 


29.1 (53) 


28.9 (101) 28.2 (71) 


28.7 (225) 


11.8 


12.3 


10.3 


11.6 


11.0 


11.4 


10.7 


11.1 


11.1 


11.7 


9.9 


11.0 


64 (9) 


29 (9) 


38 (6) 


39 (24) 


67 (2) 


40 (2) 


100 (3) 


64 (7) 


49 (26) 


37 (37) 


41 (29) 


41 (92) 


40.7 


46.8 


34.9 


42.3 


35.0 


42.0 


46.3 


41.3 


35.1 


38.8 


36.8 


37.3 


23.0 


23.9 


20.7 


22.8 


19.0 


22.0 


26.7 


24.9 


20.0 


21.9 


21.0 


21.1 


63.7 


69.8 


55.6 


64.7 


54.0 


64.0 


73.0 


63.7 


54.8 


60.5 


57.8 


58.3 


37.2 


44.8 


36.3 


40.8 


39.0 


38.4 


44.7 


40.3 


37.1 (53) 


41.8 (95) 


39.2 (70) 


39.8 (218) 


40.2 


41.0 


29.4 


37.7 


34.7 


31.0 


38.0 


33.9 


32.1 


37.5 


33.1 


34.8 


24.6 


32.5 


19.7 


27.4 


18.3 


21.6 


28.7 


22.6 


23.3 


30.1 


25.1 


27.0 


26.1 


25.5 


24.1 


25.2 


20.0 


34.0 


18.3 


25.9 


20.7 (28) 


17.3 (46) 


17.9 (34) 


18.4 (108) 


3.2 (13) 


3.0 (28) 


2.8 (15) 


3.0 (56) 


2.3 (3) 


2.7 (3) 


(3) 


2.6 (9) 


3.3 (13) 


2.8 (28) 


2.9 (15) 


3.0 (56) 


2.3 (3) 


3.0 (3) 


2.7 (3) 


2.6 (9) 




higher salary on successive jobs and length of time on last job, even 
though this group tended to score lower on most tests than the other 
two groups. 

Performance Data by Ethnic Group 

In the longitudinal phase of the present project merit ratings and 
supervisory rankings constituted the performance criteria. Merit 
ratings were available for 46 individuals and supervisory rankings were 
obtained for 65 persons. The difference in numbers is attributable to 
the length of time individuals had been employed when the project period 
was completed. In other words, a rating was recorded only if the indi- 
vidual had worked 90 days or longer, and a supervisory ranking was 
obtained only if the supervisor concerned felt that they had had suffi- 
cient time to review each attendant's performance accurately. 

The two types of performance data are shown by ethnic group in 
Tabl^ 2. The F-values represent indices of the statistical significance 
of the differences among the three ethnic group means. In all comparisons 
made, no significant differences in performance were noted. This result 
parallels the job performance result reported for the cross sectional 
phase of the study. Clearly the evidence indicates that differences 
in job performance among the three ethnic groups are attributable to 
chance rather than to ethnic group membership. 

Correlation Between Selection Data and Performance by Ethnic Group 

Crucial to any study of the selection process is the extent to 
which job performance can be predicted from evidence available at the 
time of application. The extent to which such prediction would have 
been possible in the present project was examined (1) in terms of the 



Table 2 
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Performance of Employed Attendants 



Ethnic Group 



Characteristic 


Negro(lO) Wh1te(20) 


Spanish 

Sumame(16) 


Total (46) 


Quantity (F=.382) 


3.2 


Regular Merit Review 
3.3 3.1 


3.2 


Quality (F=.134) 


3.0 


3.1 


3.1 


3.1 


Reporting Habits (F=.384) 


2.9 


3.0 


2.9 


2.9 


Overall Rating (F=.263) 


3.0 


3.2 


3.1 


3.1 




Research Ranking 

Negro(16) Wh1te(31) S.Sumame(18) Total (65) 


Ability (F=.213) 


3.1 


3.0 


2.8 


3.0 


Performance (F=.320) 


3.1 


2.9 


2.8 


3.0 


Ability Categories 




Freguency 




Total 


5 


2 


3 


1 


6 


4 


3 


8 


2 


13 


3 


6 


10 


9 


25 


2 


3 


8 


4 


15 


1 


2 


3 


2 


7 


Performance Categories 




Freguency 




Total 


5 


2 


3 


1 


6 


4 


5 


6 


2 


13 


3 


5 


12 


9 


26 


2 


1 


8 


5 


14 


1 


3 


3 


1 


7 
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coefficient of correlation between selection variables and performance 
of those ultimately hi tod and (2) in terms of the kinds of job perfor- 
mers who would have been eliminated if cutti ig score at various points 
in the test score distributions had been used. 

In Table 3 are shown the zero order coefficients of correlation 
between various predictions and the supervisory rankings with respect 
to ability to perform the job and actual performance. (Because of the 
very limited dispersion within the merit rating distributions, they were 
eliminated from further consideration as criteria of performance against 
which to compare predictor values.) Inspection of the predictors shown 
in Table 3 reveals that by far the largest number of significant coeffi- 
cients of correlation occurred within the Negro distribution. 

To assess the influence of age and education on test performance 
in relation to job performance, age and education were parti aled out 
for several of the variables as shown in Table 4. Although inspection 
of Table 4 reveals that the magnitude of the predictor-performance rela- 
tionship was reduced slightly as the result of controlling age and 
education, the results did not change appreciably. 

To determine the possible advantage of combining several predictor 
variables into a multiple prediction scheme, the stepwise regression 
analyses reported in Tables 5 and 6 were computed. Here it can be seen 
that, when the variable yielding largest zero order coefficient with the 
criterion is used as the first predictor in the scheme and the others 
are systematically combined with it, few significant increases in predic- 
tion resulted. Althou'jh several tests correlated significantly with 
performance for one or more ethnic groups, available evidence does not 
support using them in combination. 
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Table 4 

Second Order Partial Coefficients of Correlation Between 
Predictors and Criteria with Age and Education Constant 



Predictor 




Ability 






Performance 






W(32) 


SS(18) 


T(66) 


NHer 


W(32) 


SS(18) 


T(66) 


X-0 Correct 


.59* 


^.04 


.13 


.17 


.46* 


-.02 


.08 


.18 


X-0 Attempted 


.68* 


.15 


-.02 


.29* 


.58* 


.15 


.09 


.30* 


$-^ Correct 


.57* 


.02 


.07 


.23* 


.69* 


.02 


-.03 


.26* 


Attempted 


.48* 


.12 


.05 


.25* 


.64* 


.13 


-.07 


.28* 


X-0 %-t Correct 


.68* 


.04 


.13 


.26* 


.62* 


.07 


.05 


.28* 


SRA 


-.11 


.07 


.07 


.06 


-.21 


.17 


.13 


.10 


X-0 %-f. Attempted 


.66* 


.15 


.00 


.30* 


.66* 


.16 


.03 


.33* 


Matrices Correct 


.55* 


.27 


.25 


. 28 * 


.57* 


.32 


.28 


.31* 


Matrices Attempted 


-.41 


-.23 


-.14 


-.29* 


-.31 


-.34 


-.28 


-.33* 


total Interview 


.42 


.23 


-.11 


.24* 


.45* 


.13 


.17 


.27* 


Time in Denver 


-.54* 


-.15 


-.41 


-.28* 


.51* 


-.21 


-.46 


-.31* 



♦Significant at .05 level or beyond 
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Table 5 

StepMi'se Regression of Predictor Variables and 
the Criterion - Ability to Perform 

Number of F for 

Sample Variable Multiple R Predictors Increase 



Negro 


X-0 $-^ Correct 


(16) 


Time in Denver 

Total Interview Score 

SRA Score 

X-0 Attempted 

Education 

Matrices Wrong 


White 


Matrices Correct 


(32) 


Total Interview Score 

X-0 Correct 

X-0 Attempted 

$-^ Correct 

Education 

SRA Score 


Spanish 


Education 


Surname 


Age 


(18) 


Time in Denver 
Matrices Correct 
$-jC Attempted 
X-0 Correct 
SRA Correct 


Total 


X-0 $-^ Attempted 


(.66) 


Time in Denver 


Total Interview Score 
Matrices Correct 
Age 

Education 
X-0 Correct 



.75 


1 


17.78 


.79 


2 


2.28 


.82 


3 


1.75 


.84 


4 


.89 


Lf) 

00 

• 


5 


1.09 


.68 


6 


1.98 


• 

00 

VO 


7 


.85 



.26 


1 


2.26 


.37 


2 


2.14 


.46 


3 


2.93 


.56 


4 


4.08 


.62 


5 


2.89 


.66 


6 


1.97 


.67 


7 


.43 



.52 


1 


6.00 


.64 


2 


3.32 


.71 


3 


2.80 


.74 


4 


1.18 


.76 


5 


.71 


.79 


6 


1.40 


.80 


7 


.69 



.39 


1 


11.69 


.44 


2 


3.39 


.47 


3 


1.99 


.50 


4 


1.95 


.51 


5 


.95 


.52 


6 


1.26 


.53 


7 


.58 



o 

ERIC 
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Table 6 

Stepwise Regression of Predictor Variables 
and the Criterion - Performance 



Sample 


Vari able 


Multiple R 


Number of 
Predictors 


F for 
Increase 


Negro 


$-^ Correct 


.74 


1 


17.20 


ll6) 


Time in Denver 


.78 


2 


2.18 




Age 


.82 


3 


2.28 




Total Interview 


.84 


4 


1.36 




Education 


.86 


5 


.85 




X-0 Attempted 


.87 


6 


.80 




X-0 $-^ Correct 


.90 


7 


2.71 


White 


Matrices Wrong 


-.24 


1 


1.89 


(32) 


Total Interview 


.34 


2 


1.82 




X-0 Correct 


.41 


3 


1.89 




X-0 Attempted 


.52 


4 


3.51 




$-^ Correct 


.60 


5 


3.64 




$-^ Attempted 


.64 


6 


2.01 




Time in Denver 


.67 


7 


2.01 


Spanish 


Matrices Wrong 


-.46 


1 


4.34 


Surname 


Time in Denver 


.59 


2 


3.05 


(18) 


Age 


.68 


3 


3.18 




Education 


.73 


4 


1 . 85 




Attempted 


.75 


5 


.87 




Matrices Correct 


.80 


6 


2.47 




X-0 Correct 


.84 


7 


2.06 


Total 


Matrices Wrong 


-.33 


1 


7.62 


(66) 


Total Interview 


.42 


2 


5.45 




Time in Denver 


.47 


3 


3.17 




Age 


.48 


4 


1.20 




Attempted 


.51 


5 


1.85 




$-lt Correct 


.52 


6 


1.11 


- 


Matrices Correct 


.53 


7 


• 

cn 



o 

ERIC 
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Frequency Distributions and Performance by Ethnic Group 

To provide greater insight into the nature of the relationships 
between the predictor variables and the two research criteria of perfor- 
mance, two-way frequency distributions of score and criterion were 
tabulated. Whereas the distributions reflect the same general type of 
information as do coefficients of correlation, such distributions are 
especially meaningful in assessing the influence of cutting score on 
selection procedures. The frequency distributions for age, educational 
level, X-0 score, $-^ score, X-0 $-^ score, SRA score. Matrices score, 
interview rating, and time in Denver are shown in Tables 7 to 15. 

Inspection of these tables indicates that, in general, there is 
little evidence for retaining educational level as a requirement for the 
hospital attendant job. Of the approximately 10 per cent of the employed 
individuals who scored below the score of 30 on the SRA Non Verbal Test, 
four were ranked in category 4, two were ranked 3, and one was ranked in 
category 2 of job performance. If a cutting score of 49 on the X-0 $-^ 
test had been employed, four persons would have been eliminated and all 
were ranked 3 or below. If a cutting score of 17 on the Matrices test 
had been employed, eleven would have been eliminated and seven would have 
been in performance category 2 or below. Inspection of the time in 
Denver distribution reveals that most of the relationship was contributed 
by a relatively few individuals who had lived in Denver for less than 
six months who were ranked in performance categories 3 and above. 

The importance of demonstrating relationships between selection 
test score and performance is clearly shown in the present project. The 
use of such relationships, when they do exist, will be discussed in the 
section on Implications. 
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Table 7 

Distribution of Age by Selection Stage and 
Performance Level 



Selection Stage 
Inter- 

Age Tested viewed Listed Certified 



63-68 




(Negro) 




57-62 


1 








51-56 


1 


1 


1 


1 


45-50 


4 


3 


2 


i 


39-44 


10 


5 


4 




33-40 


11 


8 


6 


i 


27-32 


15 


13 


13 


11 


21-26 


16 


14 


14 


11 


15-20 


16 


12 


*10 


1 


63-68 


1 


(White) 




57-62 


4 


2 






51-56 


8 


6 


5 


3 


45-50 


7 


3 


3 


1 


39-44 


17 


14 


11 


9 


33-40 


5 


4 


2 


2 


27-32 


8 


8 


6 


5 


21-26 


24 


18 


17 


14 


15-20 


66 


46 


40 


33 


63-68 




(Spanish) 




57-62 


1 


• 






51-56 


8 


3 


2 


2 


45-50 


7 


5 


5 


4 


39-44 


4 


4 


3 


3 


33-40 


5 


4 


4 


3 


27-32 


19 


12 


9 


5 


21-26 


17 


13 


12 


9 


15-20 


31 


22 


19 


14 


9-14 


1 









Ability Performance 

1 2 3 4 5 1 2 3 4 5 



0 0 0 0 0 
0 0 0 0 0 
10 10 0 
0 10 10 
0 0 10 0 
0 2 3 1 0 
10 0 11 
0 0 10 1 



0 0 0 0 0 
0 0 0 0 0 
0 0 10 0 
0 0 0 0 0 

0 13 10 
0 0 10 0 
110 0 0 
12 13 0 

1 4 4 3 3 



0 0 0 0 0 

0 110 0 
0 0 2 0 0 

10 10 0 
0 1 I 0 1 

0 0 0 1 0 

0 0 12 1 
112 0 0 



0 0 0 0 0 
0 0 0 0 0 
0 0 10 0 
10 0 10 
10 10 0 
0 13 2 0 
10 0 11 
0 0 0 1 1 



0 0 0 0 0 

0 0 0 0 0 

0 0 0 1 0 

0 0 0 0 0 

0 13 10 
0 0 0 1 0 

110 0 0 
13 12 0 
13 7 14 



0 0 0 0 0 
0 0 2 0 0 
0 12 0 0 
0 0 10b 
0 110 1 
0 0 0 1 0 
0 12 10 
12 10 0 
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Table 8 

Distribution of Last Grade Completed by Selection Stage 

and Performance Level 



Grade 


Tested 


I nter- 

viewed Listed 


Certified 


1 


Ability 
2 3 4 


5 


i 

1 


Performance 
2 3 4 5 


15 


2 


2 


(Negro) 

2 


2 


0 


0 


0 


0 


1 


0 


0 


0 


0 


1 


14 


- 


• 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


13 


3 


3 


3 


3 


0 


1 


0 


1 


0 


0 


1 


0 


1 


0 


12 


35 


26 


24 


19 


0 


2 


3 


0 


*1 

j 


1 


0 


J 


1 


1 


11 


16 


13 


13 


12 


1 


0 


2 


2 


0 


1 


0 


2 


2 


0 


10 


10 


8 


6 


5 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


9 


2 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


8 


4 


3 


1 


1 


0 


0 


1 


0 


0 


0 


0 


0 


1 


0 


7 


1 


- 


• 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


6 


1 


• 


• 


• 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


16 


5 


3 


(White) 

1 


1 


0 


0 


1 


0 


0 


0 


1 


0 


0 


0 


15 


3 


2 


2 


2 


0 


0 


0 


1 


0 


0 


0 


0 


1 


0 


14 


7 


6 


6 


4 


0 


1 


0 


2 


0 


0 


2 


0 


1 


0 


13 


17 


12 


10 


9 


2 


2 


0 


2 


0 


2 


3 


1 


0 


0 


12 


66 


47 


39 


30 


1 


4 


6 


2 


3 


1 


2 


9 


1 


3 


11 


11 


8 


7 


7 


0 


0 


1 


0 


0 


0 


0 


0 


1 


0 


10 


19 


13 


12 


7 


0 


0 


1 


0 


0 


0 


0 


0 


1 


0 


9 


4 


3 


2 


2 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


8 


7 


6 


5 


5 


0 


0 


1 


0 


0 


0 


0 


1 


0 


0 


7 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


13 


2 


1 


(Spanish) 

1 


1 


0 


0 


1 


0 


0 


0 


0 


1 


0 


0 


12 


25 


19 


17 


12 


0 


1 


0 


2 


1 


0 


1 


0 


2 


1 


11 


16 


10 


9 


6 


0 


2 


1 


0 


0 


0 


2 


1 


0 


0 


10 


20 


14 


11 


10 


1 


0 


5 


0 


0 


1 


1 


4 


0 


0 


9 


9 


6 


6 


4 


0 


0 


1 


0 


0 


0 


0 


1 


0 


0 


8 


10 


6 


6 


4 


0 


1 


1 


0 


0 


0 


0 


2 


0 


0 


7 


7 


5 


3 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


6 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


5 


3 


2 


1 


1 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 


4 


- 


- 


- 


- 


0 


0 


0 


n 


0 


0 


0 


0 


0 


0 


3 


1 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



o 

ERIC 
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Table 9 

Distribution of X-0 Score by Selection Stage 
and Performance Level 



X-0 

Score 


Tested 


I nter- 
vi ewed 


Listed 


Certi f i ed 


1 


Abi 1 i ty 
2 3 4 


5 


1 

1 


Performance 
2 3 4 5 


50-59 


9 


(Negro) 

7 7 


5 


0 


0 


1 


0 


1 


0 


0 


1 


0 


1 


40-49 


21 


16 


16 


15 


0 


2 


2 


2 


1 


1 


1 


1 


3 


1 


30-39 


25 


20 


17 


11 


0 


1 


2 


1 


0 


0 


0 


1 


2 


0 


20-29 


14 


8 


6 


6 


2 


0 


0 


0 


0 


2 


0 


1 


0 


0 


10-19 


3 


2 


1 


1 


0 


0 


0 


0- 


0 


0 


0 


0 


0 


0 


0-9 


3 


2 


2 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


50-59 


28 


(White) 
21 20 


15 


2 


2 


1 


3 


1 


1 


1 


3 


2 


1 

fe 


40 49 


54 


41 


35 


29 


0 


4 


6 


4 


1 


1 


4 


6 


2 


1 


30-39 


38 


30 


26 


21 


1 


2 


3 


1 

1 


1 


1 


3 


2 


1 


1 


20-29 


13 


5 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10-19 


6 


4 


2 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-9 


• 


— 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


50-59 


8 


(Spanish) 
5 5 


3 


0 


1 


0 


0 


0 


0 


1 


0 


0 


0 


40-49 


30 


24 


20 


15 


0 


1 


4 


2 


1 


0 


1 


4 


2 


1 


30-39 


31 


17 


15 


13 


1 


1 


4 


0 


0 


1 


2 


3 


0 


0 


20-29 


17 


14 


12 


7 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


10-19 


5 


1 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-9 


1 


1 


1 


1 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 
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Tabla lo 

Distribution of Score by Selection Stage and 

Performance Level 



Score 


Tested 


Inter- 

viewed 


Listed Certified 


1 


Ability 
2 3 4 


5 


Performance 
1 2 3 4 5 


30-34 


2 


(Negro) 

2 2 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


25-29 


18 


15 


15 


12 


0 


1 


1 


1 


1 


0 


0 


1 


2 


1 


20-24 


26 


17 


16 


14 


0 


1 


4 


1 


1 


0 


1 


2 


3 


1 


15-19 


13 


10 


9 


7 


1 


1 


0 


1 

M 


0 


2 


0 


1 


0 


0 


10-14 


11 


9 


4 


5 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


5-9 


1 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-4 


3 


2 


2 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30-34 


5 


(White) 

3 3 


2 


0 


1 


0 


1 


0 


0 


1 


1 


0 


0 


25-29 


42 


34 


30 


25 


2 


3 


2 


5 


2 


2 


3 


4 


3 


2 


20-24 


62 


41 


35 


27 


1 


1 


6 


1 


0 


1 


1 


5 


2 


0 


15-19 


19 


13 


10 


9 


0 


3 


2 


0 


1 


0 


3 


2 


0 


1 


10-14 


8 


8 


6 


4 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


5-9 


3 


2 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-4 


- 


- 


“ 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30-34 


2 


(Spanish) 
2 2 


2 


0 


1 


1 


0 


0 


0 


1 


1 


0 


P 


25-29 


23 


14 


13 


7 


0 


0 


? 


0 


1 


0 


0 


2 


0 


1 


20-24 


41 


29 


26 


19 


1 


2 


4 


2 


0 


1 


2 


4 


2 


0 


15-19 


16 


10 


9 


8 


0 


0 


2 


0 


0 


0 


1 


1 


0 


0 


10-14 


8 


6 


3 


3 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


5-9 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-4 


2 


1 


1 


1 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 
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Table 11 

Distribution cf X-0 $-^ Score by Selection Stage and 

Performance Level 



Score 


Tested 


Inter- 
viewed Listed 


Certified 


~T 


Ability 
2 3 4 


“ 5 “ 


Performance 
1 2 3 4 5 


80-89 


3 


(Negro) 
3 3 


2 


0 


0 


0 


0 


1 


0 


0 


0 


0 


1 


70-79 


14 


9 9 


7 


0 


0 


1 


2 


0 


0 


0 


1 


2 


0 


60-69 


18 


15 15 


14 


0 


2 


3 


1 


1 


1 


1 


1 


3 


1 


50-59 


19 


15 13 


10 


0 


0 


2 


0 


0 


0 


0 


2 


0 


0 


40-49 


7 


3 2 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30-39 


8 


8 5 


5 


2 


0 


0 


0 


0 


2 


0 


0 


0 


0 


20-29 


1 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10-19 


2 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-9 


2 


2 2 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


80-89 


14 


(White) 
11 10 


8 


0 


1 


0 


3 


0 


0 


0 


2 


2 


0 


70-79 


37 


28 26 


22 


2 


4 


5 


2 


2 


2 


5 


6 


0 


2 


60-69 


34 


23 19 


14 


0 


1 


2 


1 


0 


0 


0 


2 


2 


0 


50-59 


30 


24 20 


17 


1 


2 


3 


1 


1 


1 


2 


1 


1 


1 


40-49 


16 


8 6 


5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30-39 


4 


3 1 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


20-29 


4 


3 1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10-19 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-9 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


80-89 


3 


(Spanish) 
3 3 


1 


0 


1 


0 


0 


0 


0 


0 


0 


0 


0 


70-79 


19 


13 12 


9 


0 


1 


1 


1 


1 


0 


0 


2 


1 


1 


60-69 


24 


16 13 


10 


0 


0 


1 


1 


0 


0 


1 


0 


1 


0 


50-59 


23 


14 13 


11 


1 


0 


2 


0 


0 


1 


1 


1 


0 


0 


40-49 


14 


11 10 


6 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30-39 


6 


3 1 


1 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


20-29 


1 


1 1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


10-19 


1 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-9 


1 


1 1 


1 


1 


0 


Q 


0 


0 


0 


1 


0 


0 


0 




r 
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Table 12 

Distribution of SRA Score by Selection Stage and Performance Level 



SRA 

Score 


Tested 


Inter- 

viewed 


Listed 


Certi fied 


~T 


Ability 
T "3 4 


5 


Performance 
123 4 


5 


54-50 


2 


(Negro) 

2 2 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


1 


48-53 


10 


9 


9 


7 


0 


0 


0 


1 


1 


0 


0 


0 


1 


1 


42-47 


15 


11 


11 


8 


0 


1 


1 


0 


0 


1 


0 


1 


0 


0 


36-41 


18 


12 


11 


11 


1 


2 


1 


0 


0 


1 


1 


2 


0 


0 


30-35 


13 


9 


8 


7 


1 


0 


1 


0 


0 


1 


0 


1 


0 


0 


24-29 


7 


3 


3 


3 


0 


0 


1 


1 


0 


0 


0 


0 


2 


0 


18-23 


6 


6 


3 


3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


12-17 


• 


• 


- 


• 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


6-11 


2 


2 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-5 


1 


1 


1 


1 


0 


0 


0 


1 


0 


0 


0 


0 


1 


0 


54-59 


5 


(White) 

5 4 


4 


0 


1 


1 


0 


1 


0 


1 


1 


0 


1 


48-53 


29 


20 


18 


13 


0 


2 


0 


3 


1 


0 


2 


1 


1 


0 


42-47 


51 


41 


36 


30 


2 


2 


6 


3 


1 


2 


2 


7 


1 


0 


36-41 


24 


14 


11 


7 


1 


2 


1 


0 


0 


1 


1 


2 


0 


0 


30-35 


15 


10 


7 


6 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


24-29 


4 


3 


2 


2 


0 


0 


1 


0 


0 


0 


0 


0 


1 


0 


18-23 


2 


2 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


12-17 


2 


1 


1 


i 


0 


0 


9 


0 


0 


0 


0 


0 


0 


0 


6-11 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-5 


1 


1 


1 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


54-59 




(Spanish) 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


48—53 


11 


6 


6 


4 


0 


1 


2 


0 


0 


0 


1 


2 


0 


0 


42-47 


21 


16 


16 


11 


0 


1 


0 


1 


0 


0 


1 


0 


1 


0 


36-41 


33 


21 


16 


10 


0 


1 


1 


0 


1 


0 


0 


2 


0 


1 


30-35 


18 


12 


11 


11 


1 


0 


3 


0 


0 


1 


1 


2 


0 


0 


24-29 


5 


5 


3 


2 


0 


1 


0 


0 


0 


0 


0 


1 


0 


0 


18-23 


3 


3 


2 


2 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


12-17 


1 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


6-11 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0-5 










0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
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Table 13 



Diitrlbution of Matrices Score by Selection Stage 
and Performance Level 



\ 



Matrices 

Score 


Tested 


Inter- 

viewed 


Listed 


Certified 


1 


Ability 
2 3 4 


5 


Performance 
1 2 3 4 5 


48-53 

42-47 


1 


(Negro) 

1 1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 0 


36-41 


4 


4 


4 


3 


0 


0 


0 


0 


1 


0 


0 


0 


0 1 


30-35 


14 


9 


9 


6 


0 


0 


1 


1 


1 


0 


0 


0 


1 1 


24-29 


18 


15 


13 


11 


0 


1 


3 


1 


0 


1 


0 


0 


3 0 


18-23 


14 


12 


12 


12 


0 


2 


1 


1 


0 


1 


1 


3 


1 0 


12-17 


11 


6 


5 


5 


2 


0 


1 


0 


0 


2 


0 


1 


0 0 


6-11 


12 


8 


5 


5 


0 


0 


0 


0 


0 


0 


0 


1 


0 0 


48-53 


5 


(Khite) 

3 1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 0 


42-47 


19 


15 


15 


11 


1 


2 


1 


2 


1 


1 


2 


2 


1 2 


36-41 


21 


15 


12 


12 


0 


0 


2 


3 


1 


0 


1 


2 


2 0 


30-35 


31 


20 


18 


12 


1 


3 


1 


1 


0 


1 


1 


0 


4 1 


24-29 


27 


19 


16 


13 


1 


0 


2 


1 


1 


1 


0 


2 


1 0 


18-12 


16 


11 


8 


7 


0 


1 


2 


0 


0 


0 


1 


2 


0 0 


12-17 


17 


14 


11 


9 


0 


2 


2 


0 


0 


0 


3 


0 


1 0 


6-11 


4 


4 


3 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 0 


0-5 


- 


- 


- 


- 


C 


0 


0 


0 


0 


0 


0 


0 


0 0 


48-53 

42-47 


3 


(Spanish) 
2 2 


1 


0 


1 


0 


0 


0 


0 


T 

t 


0 


0 0 


36-41 


12 


8 


6 


4 


0 


0 


0 


1 


0 


0 


0 


0 


1 0 


30-35 


14 


11 


10 


6 


0 


0 


2 


1 


0 


0 


0 


2 


1 0 


24-29 


20 


13 


12 


7 


0 


0 


2 


0 


1 


0 


0 


2 


0 1 


18-23 


16 


7 


7 


7 


1 


0 


1 


0 


0 


1 


1 


0 


0 0 


12-17 


9 


6 


5 


5 


0 


2 


0 


0 


0 


0 


1 


1 


0 0 


6-11 


13 


12 


9 


8 


1 


0 


0 


0 


0 


0 


1 


0 


0 0 


C-5 


3 


1 


1 


1 


0 


0 


1 


0 


0 


0 


0 


1 


0 0 



[ 
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Table 14 

Distribution of Total Interview Ratings by Selection Stage 

and Performance Level 



Interview Inter- Abl 1 1 ty Performance 



Rati nq 


Tested 


viewed 


Listed 


Certified 


1 


2 


3 


4 


5 


1 


2 


3 


4 


5 






(Negro) 
























45 


3 


3 


3 


3 


0 


0 


1 


1 


0 


0 


0 


1 


0 


0 


40 


1 


1 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35 




- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30 


5 


5 


5 


5 


1 


1 


0 


1 


1 


0 


1 


0 


1 


1 


25 


13 


13 


13 


13 


1 


1 


2 


0 


1 


0 


0 


2 


1 


1 


20 


13 


13 


13 


13 


0 


0 


3 


1 


0 


0 


0 


2 


2 


0 


15 


5 


5 


5 


5 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


10 


9 


9 


9 


9 


1 


1 


0 


0 


0 


2 


c 


0 


0 


0 


5 










0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 






(White) 
























45 


2 


2 


p_ 


2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


40 


1 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35 


9 


9 


9 


9 


0 


1 


2 


3 


1 


3 


1 


2 


3 


1 


30 


13 


13 


12 


12 


2 


1 


3 


2 


1 


0 


2 


3 


1 


1 


25 


6 


6 


6 


6 


0 


1 


1 


0 


1 


0 


0 


2 


0 


1 


20 


20 


20 


20 


16 


0 


2 


2 


1 


0 


0 


4 


0 


1 


0 


15 


18 


18 


18 


15 


1 


3 


1 


0 


0 


0 


1 


3 


0 


0 


10 


14 


14 


14 


6 


0 


0 


1 


1 


0 


0 


0 


2 


0 


0 


5 


1 


1 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


1 


1 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 






(Spanish) 
























45 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


40 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35 


3 


3 


3 


3 


0 


1 


0 


1 


0 


0 


0 


1 


1 


0 


30 


7 


7 


5 


5 


0 


1 


1 


1 


0 


0 


0 


2 


1 


0 


25 


10 


10 


10 


8 


1 


0 


3 


0 


0 


1 


1 


2 


0 


0 


20 


12 


12 


12 


11 


0 


2 


3 


0 


0 


0 


3 


2 


0 


0 


15 


14 


14 


14 


6 


0 


0 


2 


0 


1 


0 


0 


2 


0 


1 


10 


4 


4 


4 


4 


1 


0 


0 


0 


0 


0 


1 


0 


0 


0 


5 


6 


6 


6 


3 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


- 


- 


- 


- 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



[ 

i 
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Table 15 

Time in Denver by Selection tage and Performance Level 

Time in Inter- Ability 

Denver Tested viewed Listed Certified 12345 



More than 
36 mo. 42 
24-35 mo. 5 
12-23 mo. 3 
6-11 mo. 2 
Less than 
6 mo. 10 



(Negro) 



34 30 

5 5 

3 2 

1 1 



9 8 



(White) 

More than 

36 mo. 81 64 32 

24-35 mo. 2 1 1 

12-23 mo. 5 5 4 

6-11 mo. 3 1 1 

Less than 

6 mo. 25 21 19 



25 

3 

2 

1 

7 



39 

3 

1 

17 



More than 
36 mo. 62 
24-35 mo. 1 
12-23 mo. 5 
6-11 mo. 1 
Less than 
6 mo. 11 



(Spanish) 

41 35 28 

1 1 

3 3 3 

1 1 1 

9 8 5 



2 3 6 0 1 
0 0 0 1 0 
0 0 0 1 0 
0 0 0 1 0 

0 0 0 0 1 



1 7 3 5 2 1 

0 0 0 0 0 0 

10 10 0 1 

0 1 0 0 0 0 

1 0 2 2 1 1 



13 6 10 1 

0 0 0 0 0 0 

0 0 1 0 0 0 

0 0 1 0 0 0 

0 10 11 0 



Performance 
1 2 3 4 5 



1 5 2 1 
0 0 10 
0 0 10 
0 0 10 

0 0 0 1 



7 5 3 2 
0 0 0 0 
0 10 0 
0 10 0 

0 2 2 1 



3 6 10 
0 0 0 0 
0 10 0 
10 0 0 

0 111 
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IMPLICATIONS 

Whereas the earlier sections of this report are repleat with 
specific findings from tne two-year research project, the report would 
be incomplete without an attempt to integrate these findings into a 
meaningful theoretical model on which to base day-to-day practices. 

Such a model should serve to bridge the gap which frequently exists 
between research, on the one hand, and actual personnel practices on 
the other. 

As a first step in tying together the various findings, the three 
more salient ones will be summarized. These will then be combined into 
an overall explanation of the situation, and suggested practices will 
then be formulated. 

Salient Findings 

In general, the three more pertinent findings as related to 
original hypotheses were as follows: 

1. Job performance was comparable for the three ethnic groups 

included in the present project. The present project involved detailed 

study of performance across a variety of job classes. The present 

project also involved detailed analyses of a variety of criteria of job 

performance. In addition, the project involved two phases, a cross- 

sectional phase including individuals presently on the job at the time 

the project was initiated, and a longitudinal phase wherein the progress 

of applicants was followed for a period of several months after hire. 

In all instances, no evidence of significant differences in job performance 

among ethnic groups was noted. This finding applied to both research 

criteria defined for this project only, as well as to merit ratings and 

personnel criteria involved in the normal personnel administration process, 
o 

ERIC 
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For purposes of Illustrating this finding, the job performance variable 
will be graphed as three identical normal distributions of observations 
superimposed along the vertical axis of a two-way distribution as follows 
(Figure 1): 




Figure 1. Comparable Job Performance for Three Ethnic Groups 



2. In the majority of the selection tests administered throughout 
the present project. Whites scored highest, Spanish-surname personnel next, 
and Negroes scored lowest. This tended to be true for verbal material, 
perceptual discrimination, abstract reasoning, and to a lesser extent, oral 
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and visual memory. It should be noted, of course, that there was 
considerable overlapping among all the distributions and the differences 
noted were based primarily on measures of the central position of the 
distributions. 

Graphically, this finding can be illustrated by erecting three 
normal curves below the baseline of a two-way distribution (Figure 2): 





Figure 2. Comparable Job Performance and Differential Predictor Performance 
for Three Ethnic Groups 
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3. The correlation between test scores and job performance tended 
to be highest for Negroes, next for Spanish-surname personnel, and 
lowest for Whites. Although the coefficients of correlation between 
test score and job performance were not all statistically significant 
across all the tests investigated, more significant correlations were 
found for Negroes and Spanish-surname personnel than for Whites. This 
was especially true of the longitudinal phase of the project wherein the 
data were uncontaminated by cross sectional factors such as differences 
in length of employment, in differential change in the individual since 
time of application, etc. By expressing the coefficient of correlation 
in terms of plotted points away from a regression line on a two-way 
frequency distribution, Ihe three magnitudes of coefficient can be shown 
on the following page (Figure 3). 

In terms of the prediction of job performance from these three 
schemes, it is apparent that prediction will be most accurate within 
the Negro group, then within the Spanish-surname group, and least accu- 
rate within the White group. In fact, as the coefficient of correlation 
approaches zero, the only prediction which can be made approaches the 
mean of the criterion distribution. Conversely, as the coefficient of 
correlation approaches one, prediction throughout the range of the 
criterion becomes possible with increasing accuracy. Thus, when a Negro 
scores high within his own test distribution, a high predicted performance 
resuilb, In the case of a White, however, the coefficient of correlation 
is insufficient to permit accurate prediction from either high or low 






test scores. 
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Figure 3. Comparable Job Performance, Differential Predictor Performance 
and Unequal Validity Coefficients for Three Ethnic Groups 



Application of the Model 

Thus, it can be seen that the test results could provide 
information about the probability cf success of job applicants 
ethnic groups but not for others in the present circumstances. 



additional 
for some 
It will 



be recalled that there were no differences among the distributions of 
the interview ratings assigned to the three ethnic groups, but that the 
correlations between interview ratings and job performance were rela- 
tively low. This suggests that the probability of success on the job 
for Negroes and Spanish-surname personnel is not assessed as accurately 
with interviews as with tests, despite the fact that scores on the tests 
for the two minority groups were not as high as they were for Whites. 
Procedures are therefore needed which will more accurately identify the 
probability of job success for applicants than are currently available 
from the interview ratings alone. This means that when applicants are 
listed on the basis of interview ratings, not all available information 
is being used to refine the listing. It is suggested that more accurate 
selection could be obtained by modifying the position listing of 
Negroes and Spanish-surname personnel according to their test scores— 
since these scores correlate significantly with job performance, andbby 
leaving the positions of the Whites alone, since their scores do not 
correlate significantly with job performance. In other words, the positi 
on the list should reflect the relative probability of success on the 
job of the various applicants. By using the additional information 
obtained from the testing procedures, increased precision in the assign- 
ment of probabilities for success should be possible. This would mean 
rearranging the list so as to place high scoring Negroes and Spanish- 
surname personnel above some White applicants. The object of listing is 
to rank applicants in order of their predicted success on the job. If 
high scoring Negroes and Spanish-surname personnel have higher probabili- 
ties of job success than some Whites, then these individuals should be 



selected first. 



r 
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To obtain an indication as to how this procedure might have 
affected the 66 persons employed in the longitudinal phase of the present 
project, each minority group applicant's position in bis ethnic group's 
distribution of X-0 total score was noted and a modified distribu- 
tion for Negroes and for Spanish-surname personnel was constructed by 
adding weights to the interview ratings as follows: 



Score 

80+ 

70-79 

60-69 



Negro Weight 

9 

6 

3 



Spani sh- 
surname Weight 

6 

4 

2 



The smaller weights were assigned to the Spanish-surname group because 
of the lower correlation between their score and their job performance. 
Whereas the zero order coefficient of correlation between the interview 
ratings and job performance for the total group without the adjustment 
v/as .24, this value was found to be .44 after the adjustment. 

The change in position rankings of minority group members after 
the weighting was as follows: eleven of 16 Negroes employed were assigned 

weights; one was assigned nine points and his performance category was 
5; three were assigned six points and hheir performance categories were 

4, 4 and 3; six were assigned three points and the performance categories 
were 5, 4, 4, 3, 3, 2 and 1. Thus it can be seen that nine of the eleven 
individuals assigned weights were average or above average performers. 

Of 18 Spanish-surname personnel, ten were assigned weights. Of these, 
one received six points (rating 3), four received four points (ratings of 

5, 4, 3 and 3), and five received two points (ratings of 4, 3, 3, 3 and 1). 
In this instance only one individual was a below average performer. 
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In general » the interview ratings are assigned individuals in 
increments of five units. This means that many individuals on the 
final list may "occupy" the same position on the list. Assignment of 
weights other than multiples of five tends to "break up" this pattern 
and disperse individuals throughout the range. Thus, assignment of 
values based on the test scores has a greater effect on the ranking 
distribution than might be readily apparent. 

It has been demonstrated that a procedure of adjusting the inter- 
view ratings according to favorable test performance could increase the 
accuracy with which job performance is predicted. It should be noted, 
however, that the foregoing demonstration may yield spuriously high 
accuracy since the adjustments were applied to the distribution on which 
the original coefficient had been computed. Undoubtedly, some shrinkage 
might have occurred if the procedure had been applied in a cross- 
validation sample. Although such a sample was unavailable for the present 
project would permit an accurate evaluation of the suggested procedure. 

In addition, another test score than the $-^ X-0 test or combinations 
of test scores could have been used to obtain the weights. The procedure 
might have been further refined by using more accurate weights, such as 
those obtained from a least squares regression scheme for predicting 
performance. 

Hypothesized Explanation of Findings 

Whereas the foregoing model describes the interrelationships among 
job performance, selection test scores, and probability of success on 
the job, it does not provide an explanation for the reported conditions. 
Such an explanation can only be hypothesized from a logical analysis 
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of the labor market and employment possibilities existing in Denver at 
the time the present project was conducted. Such an explanation is 
hypothesized in the following section. 

It will be recalled that the job “hospital attendant" can be 
considered, at best, an entry position so far as the total job market 
is concerned. Both in terms of salary and job duties, it must be placed 
relatively low on the overall job hierarchy. This means that applicants 
would ordinarily apply for higher level jobs if such jobs were available 
to them, rather than the lower-level hospital attendant assignments. It 
is here postulated that higher level jobs may have been available to the 
general White population at the time this project was conducted, but that 
higher level jobs were less available to minority group personnel. The 
minority group applicant population therefore contained many individuals 
who might have applied for higher level jobs had they had the oppor- 
tunity to do so. On the other hand, it is postulated that the Whites 
did have such opportunities, thus leaving only less well qualified (even 
though higher scoring) individuals in the hospital attendant applicant 
group. This, in turn, meant that it was possible to identify many 
"better qualified" Negroes and Spanish-surname personnel than Whites, 
and the presence of these individuals in the minority work group accounted 
for the higher correlations between test score and job performance found 
in the minority subgroups. 

This condition can be further illustrated as follows: 

Let it be assumed that the total populations of White job applicants, 
Spanish-surname job applicants, and Negro job applicants can each be 
represented by a normal curve above a baseline of "qualification for 
employment in Denver." Schematically, the situation would be as follows: 
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If, by the application of selection procedures which identify the more 
well qualified individuals above some hyoothetical cutting point, then 
only the highly qualified Negroes, the above average Spanish-surname 
personnel, but some of the average and the below average Whites will 




of the minority group personnel the employer will more nearly assure 
high performance on the job than if he selects a preponderance of the 
White applicants. The problem is, of course, one of identifying these 
individuals at the time of application. It is here that the testing 
procedure could actually be of benefit to, rather than a hinderance to, 
minority group personnel. Before this condition can prevail, ethnic 
group membership must be identifiable at the time of application, and 
insight into the performance on tests of minority groups must be available, 
To obtain some indication of the types of job applicants in the 
minority group applicant pool for the hospital attendant job, a compari- 
son was made between the mean score of the Denver Negro group and the 



mean scores of some other work groups who had taken the Matrices Test. 
These data were available from administrations of the Matrices Test in 
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other situations involving minority group personnel (one JOBS program 
and one training program). The scores available for the other groups 
and for the Denver applicants were as follows: 



Origin Number 

of Data of Cases 


Job Classification 


Mean Score 


San Francisco 


10 


Aircraft Cleaner 


19.9 


New York 


10 


Aircraft Cleaner 


23.9 


Newark 




Aircraft Cleaner 


21.6 


Chicago 


14 


Aircraft Cleaner 


19.6 


Los Angeles 


7 


Kitchen Helper 


21.3 


New York 


10 


Kitchen Helper 


22.2 


Denver 


3 


Kitchen Helper 


29.3 


Denver 


2 


Dining Service Helper 


24.5 


San Francisco 


12 


Kitchen Helper 


18.8 


Chicago 


6 


Janitor 


15.0 


San Francisco 


5 


Janitor 


23.2 


Jamaica 


128 


Mechanic 


25.3 


Total Denver 


Negro Applicants 


74 


Hospital Attendant Applicants 


22.7 


Employed Denver 


Negroes 


17 


Hospital Attendants 


24.0 



The Jamaicans were enrolled in a technical training program leading to 
positions as engine mechanics, were relatively oung (early twenties) and 
had relatively good educational backgrounds (some were college graduates). 
The JOBS trainees were enrolled in training programs leading to entry- 
level positions in aircraft maintenance, janitorial and food service 
work . 

From the foregoing it is apparent that the Negro hospital attendant 
applicants were a relatively high scoring group in relation to others 
who have taken the Matrices test. No other comparable test data were 
available. 

Additional evidence about the Denver applicant group is available 
from the background characteristics presented earlier. Here it will be 
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recalled that the Negro group was characterized by upward mobility, job- 
wise, and by considerable stability in their former positions. 

As a practical selection procedure, it is suggested that all 
applicants be interviewed first, rated on the basis of the interview, 
and then tested. Ethnic group membership could either be obtained 
voluntarily at the time of application or as the result of the interview 
(just as such membership in a minority group is now obtained by asking 
supervisors to report the member of minority group personnel under the 
supervision when surveys are made). On the basis of test scores inter- 
preted according to minority grouo norms, the interview ratings could 
then be adjusted as they were in the foregoing demonstration. This 
procedure therefore becomes a concerted effort on the part of the pros- 
pective employer to assign the applicant with high probability of success 
to a realistic rank among the total applicant group. The fact that ethnic 
group membership is, in effect, a moderator variable in the prediction 
scheme is incidental to the accurate assignment of the probability of 
success on the job. 

The suggested procedure can be diagrammed schematically as follows: 

Hi qh — Predi ct Hi gh 

/ 

Negro Selectioni-^ Above— Predict 

Test \^Average Above Average 

Average— Predict Average 

Application— Interview— White Normative Test Predict Average 

High Predict High 

Spanish — Sel ecti on Above Predict 
Surname Test ^^Average Above Average 





Average —Predict Average 
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This suggested procedure will result in minority group applicants being 
hired “ahead of" White applicants. Are these individuals not being 
discriminated against? The answer rests with the definition adopted for 
the term "discrimination." To the extent that the accuracy of assign- 
ment of probability of success on a future job is increased, then 
discrimination is being reduced. The procedure here suggested simply 
modifies the assigned probabilities to be more nearly in line with the 
research evidence. As different research evidence is obtained, then 
the procedure must be changed. 

The explanation of the findings presented here ties the results of 
the project closely to the labor market within minority groups in the 
Denver area. It was postulated that, because of some circumstance or 
other, the Denver labor supply is more favorable within minority groups 
of applicants than within the White group of applicants. As more higher 
level jobs become available to the Negroes and Spanish-surname personnel 
of the area, the composition of the hospital attendant applicant group 
will undoubtedly change. When this occurs, the selection procedure 
used to assign probabilities of success to each applicant in the total 
group must be changed. It is entirely conceivable that the coefficient 
of correlation between test scores and job performance will become lower 
as this occurs. If it does, then the testing could be dropped altogether. 
On the other hand, if the job is upgraded, or if some job crisis should 
occur (such as a major depression), and other jobs are disproportionately 
downgraded, then the White applicant population may change and this will 
require a change of selection procedure also. These possibilities simply 
underscore the critical need for additional research of this type. 

As greater comprehension is gained into all facets of employee selection 
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and placement, satisfaction of the employee and satisfaction of the 
employer are more nearly assured. Without the systematic collection 
of evidence, however, such comprehension is unlikely to result. 

Consideration of Selection Stage Procedur e 

In an earlier section of this report it was pointed out that time 
delays in the overall selection process tended to affect minority 
personnel more than Whites. This suggests that minority applicants with 
high probability of success on the job may be inadvertently dropped 
from further consideration wherever time delays could be eliminated. 
Whereas the Career Service Authority is aware of this factor and has 
already taken steps to overcome this condition, it bears repeating here 
that the elapsed time from application to hire must be kept as short as 
possible to retain all applicants as long as possible. It is recommended 
that application, interviewing and listing be carried out on the same 
day and that hospital interviewing be "speeded up" by modifying the 
"rule of three" procedure. In other words instead of calling three 
applicants for hospital interview when each opening occurs (and selecting 
one while asking the other two to return with a third applicant when 
another opening occurs), interviews at the hospital could be held only 
when several openings are available and then a relatively high proportion 
of all those interviewed could be hired immediately. For example, if 
six openings were available and nine applicants were Interviewed, this 
might result in lesser attrition of prospective employees having high 
probability of job success than if the applicants came for interview 
three at a time for single openings with time delays between stages. 
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Summary Statement 

Selection officials in the public service have a grave responsi- 
bility to the public and to the prospective employee to select indivi- 
duals according to the probability of job success of applicants. This 
probability for any individual or subgroup of individuals will vary 
tremendously with the complexity of the job concerned and the guality 
of applicants comprising the labor market. It is essential, therefore, 
that selection procedures be sufficiently flexible to change as the 
labor market changes. In the present labor market in the Denver area, 
differences exist among ethnic groups in terms of their probability of 
success on the job of hospital attendant. As a temporary means of 
reflecting these differences, it has been suggested that test scores of 
Negroes and Spanish-surname personnel be used to modify the rankings they 
would otherwise receive on the basis of interview only. If the labor supply 
changes and the test results no longer mean the same as they do now, 
then the selection procedure can be changed accordingly. It should not 
be inferred from this discussion that standards are to be reduced or 
that the selection responsibility is to be taken less seriously than 
previously. Rather, the inference is that the only fair selection 
procedures are those which assign egual probabilities of being hired to 
those who have egual probabilities of success on a job. This principle 
should guide all selection decisions. The recommended procedure is an 
attempt to create this situation. 
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COLORADO CIVIL SERVICE COMMISSION 

Data pertaining to four groups of jobs were obtained from the 
Colorado Civil Service Commission for the present project. These job 



groups were as follows: 
Group One: 

Group Two: 

Group Three: 



Intermediate Clerk Typist 

Clerk Typist 
Senior Clerk Typist 
Dictating Machine Operator 

Clerk Stenographer 
Intermediate Clerk Stenographer 
Senior Clerk Stenographer 

Group Four: Resident Supervisor Trainee 

Applicants for jobs in Groups One and Four completed the three low 
verbal tests. Matrices, X-0 $-^ Test and Visual Memory at the time of 
application in addition to all other tests required in the selection 
process. Applicants for jobs in Groups Two and Three indicated their 
ethnic group membership at the time of application but did not take the 
low verbal tests. In no instance were the low verbal tests involved in 
the selection decisions. 

Three types of results were obtained from analysis of data from 
the Colorado Civil Service Commission. These were as follows: 

1. Selection Stage, Ethnic Group and Demographic Data, 

2. Performance Data by Ethnic Group for Those Employed, and 

3. Coefficients of Correlation Between Prediction ^Variables and 
Ratings in Four Areas of Performance for the Total Group 

of Employed Individuals. 

Selection Stage by Ethnic Group - Group One 

In Graph 27 is shown the pattern of attrition-survival through 
the selection procedure used by the Colorado Civil Service Cotnnission for 
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Graph 27. Attrition-Survival by Selection Stage and Ethnic Group - Group One 
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Intermediate Clerk Typists. The "selection system" represented in this 
and all subsequent graphs is similar to that designed for the Career 
Service Authority (Graphs 1-26) but reflects the specific stages and 
conditions of elimination from consideration unique to the State Civil 
Service employment procedures. Inspection of Graph 27 reveals remarkable 
consistency of percentages of the three ethnic groups moving through 
the various selection stages. Even with the very small number of cases 
involved in some cells of the graph, the percentages seldom vary from 
expectancy by more than five per cent. 

In Graph 28 the ages of the applicants are shown. Although the 
differences among the group are not statistically significant (F=1.797), 
the Spanish-surname applicants tended to be younger, on the average, 
than the other two groups of applicants. Whereas the White applicants 
rejected because of failing both performance and written tests tended 
to- be older than the mean age of the tested group, the Negro and Spanish- 
surname rejects tended to be younger. 

In Graph 29 the educational levels of the groups in terms of years 
of formal schooling completed are shown. Within the total applicant group, 
the Negroes had a slightly higher level than the other two groups. 

In Graphs 30 through 34 are shown the low verbal test scores by 
selection stage and ethnic group. As was true for the hospital attendant 
applicants and for most of the presently employed individuals in the 
cross sectional phase of the projects. Whites tended to score highest, 
followed, in turn, by the Spanish-surname group and the Negroes. 

Although some correlation between selection stage and employment is 
apparent from this and other graphs in this section, these relationships 
can be better understood from analyses contained in subsequent sections 
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Graph 29. Education by Selection Stage and Ethnic Group - Group One 
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Graph 30. X-0 Score by Selection Stage and Ethnic Group - Group One 
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Graph 31. $-(t Score by Selection Stage and Ethnic Group - Group One 
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Graph 33. Visual Memory Score by Selection Stage and Ethnic Group -Group One 
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Graph 34. Matrices Score by Selection Stage and Ethnic Group - Group One 
♦Significant at .05 level or beyond 
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of the report. 

In Graphs 35 through 46 are shown the results of analyses of the 
scores of tests and other selection procedures used by the Colorado 
Civil Service Conmission for Intermediate Clerk Typists. 

On the score for Book I-B and the written test, the Negroes scored 
highest. On the typing test and interview ratings, the Spanish-surname 
applicants scored highest. Otherwise, the White applicants tended to 
rank first. 

As seen in Graph 47, a higher percentage of Spanish-surname 
applicants was married than the other two groups, this despite the younger 
age of this group. 

The Negro and Spanish-surname groups had held their last position 
for a shorter period of time and had lived in Colorado a shorter period 
of time than the White group (Graphs 48 and 50). Whereas the salary 
at last employment was coinparable for Negro and White applicants, the 
Spanish-surname applicants had been earning considerably less (Graph 49). 
This, of course, may be related to their younger age. 

Selection Stage by Ethnic Group - Group Two 

In Graphs 51 through 76 are shown the test and selection data by 
selection stage and ethnic group for applicants in Graph II. Only if 
applicants had applied for listing in Group Two as well as Group One 
would the Group Two personnel have been administered the low verbal 
tests (Graphs 54 through 58). For analyses in the present project, each 
applicant was classified in the highest category for which he was apply- 
ing, unless he was hired into a lower job, and then he was re-classified 
accordingly. 
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Graph 36. Book I-B Score by Selection Stage and Ethnic Group - Group One 
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Graph 37. Books I -A and B Combined Score by Selection Stage and Ethnic Group 
- Group One 
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Graph 38. Books I -A and B Weighted Score by Selection Stage and Ethnic Group 
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Graph 39. Book II-A Score by Selection Stage and Ethnic Group - Group One 
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Graph 40. Book II-B Score by Selection Stage and Ethnic Group - Group One 
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Graph 41. Total Raw Score by Selection Stage and Ethnic Group - Group One 
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Graph 42. Converted Score by Selection Stage and Ethnic Group - Group One 
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Graph 43. Typing Score by Selection Stage and Ethnic Group - Group One 
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Graph 44. Written Test Score by Selection Stage and Ethnic Group - Group One 
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Graph 45. Oral Rating by Selection Stage and Ethnic Group - Group One 
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Graph 53. Education by Selection Stage and Ethnic Group - Group Two 
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Graph 56. X-0 $-i Score by Selection Stage and Ethnic Group - Group Two 
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Graph 57. Visual Memory Score by Selection Stage and Ethnic Group - Group Two 
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Graph 58. Matrices Score by Selection Stage and Ethnic Group - Group Two 
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Graph 60. Book I-B Score by Selection Stage and Ethnic Group - Group Two 
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Graph 61. Book A and B Combined Score by Selection Stage and Ethnic Group 
Group Two 
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Graph 62. Book A and B Weighted Score by Selection Stage and Ethnic Group 
Group Two 
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Graph 63. Book II-A Score by Selection Stage and Ethnic Group - Group Two 
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Graph 64. Book II-B Score by Selection Stage and Ethnic Group - Group Two 
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Graph 65. Book II-C Score by Selection Stage and Ethnic Group - Group Two 
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Graph 66. Book II-E Score by Selection Stage and Ethnic Group - Group Two 
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Graph 67 . Total Raw Score by 



Selection Stage and Ethnic Group - Group Two 
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Graph 68. Converted Score by Selection Stage and Ethnic Group - Group Two 
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Graph 69. Typing Score by Selection Stage and Ethnic Group - Group Two 
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Graph 70. Written Score by Selection Stage and Ethnic Group - Group Two 
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Graph 71. Oral Rating by Selection Stage and Ethnic Group - Group Two 



o 

ERIC 



129 




130 



APPLICATION 



ORAL 



ELIGIBLE LIST 



N 

% 



1 TESTED 


P 




S 


T 


h 


44 

41 


7 

88 


54 

4t 



IJ 


U 


S 




3 


44 


7 


54 


43 


41 


88 


Jl] 



i ^ 


W 


S 


Ti 




16 

37 


2 

67 


19 1 
40 1 



1 ^ 


w 


S 


T1 


Iso 


16 

41 


2 

67 







N 


TT 




T1 


REFERRAL 


0 


4 


1 


5 1 




0 


31 


100 


33 j 



N 


W 


S 


T 











N 


W 


S 


T 


















1 


20 


4 


25 


100 


..56_. 


J00_ 


6L 


1 


6 


1 


8 


25 


30 


LlOO 


32 


0 


2 


0 


2 


0 


50 


0 


50 



N 


W 


C 


T 











H 


W 


S 


T 


0 


3 


0 


3 


0 


60., 


j 


|6Q , 


1 


9 


1 1 


11 


50 


43 


50 


|44 



N 


W 


S 


T 



























Withdrew 



Rejected - Qualifications 
Rejected - Written Test 

Rejected - Performance Test 

Rejected - Both W & P 
DNA for Oral 

Failed Oral 



Self Removal Before 
Referral 

Still on Li«.t w/o Referral 



Self Removal 

Referred & Rejected by 
Agency 

Still on List after Tie 





WoH 

High 


ced More Than 90 pj 
Standard 


lys. ... , . 

Low 


N" 


■ W 


"S 


T 


N 


W 


S 


T 


N 


W 


S 


T 










0 

0 


3 

38 


1 

100 


4 

44 











1 



Worked Less Than 90 Days: 



Would Rehire 


Would No1 


Rehire 


N 


w" 


rs"] 






I ' W ' 


_ S . 


T 


0 


1 


0 


1 












33 




33 











Graph 73. Marital Status (Yes) by Selection Stage and Ethnic Group - Group 
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Graph 74. Length of Last Employment by Selection Stage and Ethnic Group - Group Two 
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Graph 75. Salary at Last Eiaploynient by Selection Stage and Ethnic Group 
Group Two 
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Graph 76. Length of Residence in Colorado by Selection Stage and Ethnic Group - 
Group Two 
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From inspection of Graphs 51 through 76 it can be noted that 
the Whites were significantly older than the other groups. The Negroes 
in Group Two were slightly better educated, but the Whites tended to 
score higher consistently on tests other than on the written test, 
where the Spanish-sumame personnel scored highest. The Spanish-sumame 
(.ersonnel were also given the highest oral interview ratings, which was 
also reflected in the highest ranking for this group in terms of Total 
Rounded Score. As in Group One personnel, a higher percentage of Spanish- 
sumame applicants was married, the Whites had held their previous job 
longer and had lived in Colorado longer. For ^ose for whom salary data 
were available, the Spanish-sumame personnel had received highest pay 
in their last job. 
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Selection Stage by Ethnic Group - Group Three 

In Graphs 77 through 97 ?re shown the characteristics of 
applicants comprising Job Group Three— Clerk Stenograoher, Intermediate 
Clerk Stenographer and Senior Clerk Stenographer. In this job group 
there were no minority group personnel, consequently only entries for 
Whites appear in the graphs. 

The availability of other positions for persons with high level 
skills is reflected in the relatively high proportion of applicants who 
voluntarily removed themselves after having been placed on the eligible 
list (Graph 77). This prooortion is considerably higher than for the 
other groups. 

Differences in age bv selection stage are apparent from Graph 78. 
In general, those who were eliminated from further consideration because 
of written and performance test scores tended to be older than those 
given further consideration. 

Some evidence of the validity of Books I-A and B and II-A and B 
is apparent from the generally increasingly high mean scores of referred 
applicants as the comolexitv of the three job groups increased. These 
scores were as follows: 







Neqro 


White 


Spanish- 

Surname 


Total 


Group One 


Book I A 
Book 16 
Book IIA 
Book IIB 


59.0(1) 

59.0(1) 

33.0(1) 

32.0(1) 


66.6(12) 

41.5(12) 

37.1(24) 

36.5(24) 


73.5(2) 

50.5(2) 

32.8(4) 

34.0(4) 


67.0(15) 

43.2(15) 

36.3(29) 

36.0(20) 


Group Two 


Book lA 
Book IB 
Book IIA 
Book IIB 




71.5(6) 

50.2(6) 

36.8(9) 

35.5(11) 


40.0(1) 

27.0(1) 


37.1(10) 

34.7(12) 
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Graph 77. Attrition Survival by Selection Stage - Group Three 
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Graph 78. Age by Selection Stage - Group Three 
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Graph 79. Education by Selection Stage - Group Three 
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Graph 96. Salary at Last E ployment By Selection Stage - Group Three 
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Graph 97. Length of Residence in Colorado by Selection Stage > Group Three 



Negro 



White 



Spanish 

Surname 



Total 



Group Three Book lA 78.8(5) 

Book IB 48.4(5) 

Book IIA 39.2(14) 

Book IIB 42.4(14) 



The evidence pertaining to the Written Test was not comparable, however 
In considering salary in relation to selection stage for Group 
Three, the influence of the relation between salary on last job and 
seniority is apparent. It will be recalled that those eliminated from 
further consideration because of tests were older than the group in 
general. From Graph 96 it is apparent that they had been more highly 
paid, and from Graph 95 it is apparent that they had held their jobs 

longer. 



Selection Stage by Ethnic Group •• Group Four 



The attrition-survival of the three ethnic group members through the 
various selection stages is shown for the Resident Supervisor Trainee 
aoplicants in Graph 98. Here it can be noted that the percentages of 
ethnic subgroups referred are identical with the percentages of ethnic 
subgroups applying for this job. In general, the Spanish-surname 
personnel tended to be younger than the other two groups as indicated 
in Graph 99. Educational levels of the applicants tended to be comparable, 
however (Graph 100). 

In contrast to the situation involving hospital attendants, the 
three ethnic grouos were more comparable to each other on the low verbal 
tests as shown in Graphs 101 through 105. Applicants for the resident 
supervisor trainee job also scored higher on the same tests. This 
reflects the tendency of the higher level jobs to attract applicants who 
are better educated and who score higher on tests, even though they are 
in the same general age group. 

Although the differences are not significant, it is interesting to 
note that Negro and Spanish-surname applicants were given higher oral 
interview ratings than White applicants as shown in Graph 107. These 
ratings tend to correlate with the superior salary on last job and length 
of time on last job for the Negroes as reflected in Graphs 110 and 111. 

Overall, the aoplicants for the resident supervisor trainee 
position, particularly the minority group applicants, tended to score 
higher than applicants for hospital attendant. This emphasized the 
unigueness of the labor supply for each job. 
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Graph 99. Age by Selection Stage and Ethnic Group - Group Four 
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Graph 100. Education by Selection Stage and Ethnic Group - Group Four 
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Graph 101. X-0 Score by Selection Stage and Ethnic Group - Group Four 
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Graph 105. Matrices Score by Selection Stage and Ethnic Group - Group Four 
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Graph 106. Written Score by Selection Stage and Ethnic Group - Group Four 
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Graph 107. Oral Rating by Selection Stage and Ethnic Group - Group Four 
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Graph 108. Total Rounded Score by Selection Stage and Ethnic Group - Group Four 
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Graph 112. Length of Residence in Colorado by Selection Stage and Ethnic Group- 
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Performance of Employed Personnel 

To assess the differences in oerformance among employed personnel 
in the four job groups in the State Civil Service, supervisors 
completed a four-part rating of performance for 94 individuals. Of 
these, 48 were in Group One jobs, 13 in Group Two, 15 in Group Three 
and 18 in Group Four. The mean ratings assigned to the employed 
personnel in the four groups classified by ethnic group membership 
are shown in Table 16. Inspection of this table reveals that the 
differences among the ethnic groups within job groupings were not 
significant. Although the numbers are so small as to prohibit meaning- 
ful generalization, it is interesting to note that the five Spanish- 
surname clerical employees received slightly more ratings of 5.00 or 
above than the other two groups. 

Coefficients of Correlation Between Predictors and Job Performance . 

To understand the relationship between the test scores and other 
prediction variables involved in the present project and performance 
on the job for the State Civil Service employed personnel, coefficients 
of correlation were computed between each predictor and each of the 
four job performance ratings. These coefficients of correlation are 
shown in Tables 17 through 20. Unfortunately, the number of minority 
group personnel employed did not permit comparison of predictors and 
performance within ethnic groups. 

From Table 17 it can be noted that considerable variation in 
predictive effectiveness was reflected among the prediction variables 
and performance for the Intermediate Clerk Typist group. Since the 
significance of the coefficients is a function of sample size, many 
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of the larger coefficients (based on a small number of cases) are not 
significantly different from zero. Further, in several instances, 
the direction of the relationship is negative. 

It will be recalled that the low verbal tests were not used in 
making selection decisions, hence these data are less contaminated than 
those for the other tests. The X-0 $-^, Visual Memory and Matrices all 
offer some evidence of validity for use with applicants from this 
grouD. The presently used "Written" test did not correlate well with 
performance for this group, although the oral rating did show some 
validity. 

The small number of cases tested in Group Two make generalization 
from Table 18 relatively unmeaninqful . It would appear, however, that 
in contrast to some evidence of predictive effectiveness in Group One 
the oral rating was not effective for Group Two with this sample. 

In Table 19 are shown the results from the predictor analyses 
for Group Three employed personnel. This group did not take the low 
verbal series. As with the other two groups, evidence of the validity 
of the predictors is limited. It should be emphasized, however, that 
the use of the tests in the selection decision undoubtedly contributed 
to the low coefficients. 

In Table 20 are shown the coefficients between various predictors 
and the job performance of the Resident Supervisor Trainees involved 
in the project. From this table, it can be noted that the prediction 
variables were uniformly ineffective in predicting success on the job. 
Apparently the labor market and the nature of the job make the use of 
tests for selection purposes for this job quite unmeaningful. 
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Summary Statement 

The proportion of minority group personnel employed for State Civil 
Service jobs in relation to the proportion applying for such jobs was 
found to be comparable. The absolute number of minority group 
personnel applying for (and being employed in) clerical jobs is very 
small, however. Attention to recruiting techniques to reach minority 
group members is recommended. 

Although the small number of cases involved in this phase of the 
project prohibited meaningful generalizations, little evidence was 
found to indicate validity for many of the prediction devices used for 
selection purposes. It is recommended that a systematic and concerted 
effort be initiated to determine the effectiveness of present devices 
and to evaluate other devices which might prove to be valid. 
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Table 16 



Performance of Employed Personnel by Job and Ethnic Group 



Performance 

Category 



Ability to Learn 
Quantity of Work 
Quality of Work 
Knowledge of Work 



Ability to Learn 
Quantity of Work 
Quality of Work 
Knowledge of Work 



Ability to Learn 
Quantity of Work 
Quality of Work 
Knowledge of Work 



Ability to Learn 
Quantity of Work 
Quality of Work 
Knowledge of Work 







F 


Negro 


White 


Surname 






Job 


Group One 












1. 


567 


3.50 (2) 


4.86 


(42) 


5.50 


(4) 






000 


5.00 


5.00 




5.00 






1. 


114 


4.00 


5.24 




5.50 






1. 


565 


3.50 


4.60 




4.00 








Job 


Group Two 










less 


than 


1.00 




4.17 


(12) 


5.00 


(1) 


less 


than 


1.00 




4.42 




4.00 




less 


than 


1.00 




5.00 




5.00 




less 


than 


1.00 




4.17 




5.00 








Job 


Group Three 


















5.07 


(15) 














5.07 
















5.27 
















5.07 












Job 


Group Four 










less 


than 


1.00 


4.00 (1) 


3.87 


(15) 


4.00 


(2) 








3.00 


3.93 




3.00 










4.00 


3.87 




3.50 










4.00 


4.00 




4.50 





Group One - Intermediate Clerk Typist 

Group Two - Clerk Typist, Senior Clerk Typist, Die. Mach. Operator 
Group Three - Clerk Steno, Int. Clerk Steno, Senior Clerk Steno 
Group Four - Resident Supervisor Trainee 




Table 17 



Coefficients of Correlation Between Predictor Variables 
and Four Ratings of Performance - Group One 

Predictor Abi 1 i ty Quantity QuaTTty Knowl edge 

Variable N to Learn of Work of Work of Work 



Age 


48 


Education 


47 


X-0 Right 


35 


X-0 Wrong 


35 


Right 


35 


$-d Wrong 


35 


X-0 $-i Right 


35 


X-0 $-<t Wrong 


35 


Visual Memory Right 


24 


Visual Memory Wrong 


24 


Matrices Right 


35 


Matrices Wrong 


35 


Book I A 


14 


Book I B 


14 


A & B Combined 


14 


A & B Weighted 


12 


Book II A 


28 


Book II B 


28 


Total Raw Score 


23 


Converted Raw Score 


23 


Typing 


44 


Wri tten 


44 


Oral Rating 


45 


Rounded Value 


40 


Ability to Learn 




Quantity of Work 




Quality of Work 





1 

• 

ro 

O) 


-.19 


-.21 


-.03 


-ji 


1 

• 

ro 


-.08 


.00 


.08 


.12 


.30 


.14 


-.19 


-.08 


-.20 


.33 


.19 


.19 


.23 


.22 


-.24 


-.32 


-.17 


-.10 


.18 


.20 


.32 


.23 


.28 


-.21 


-.26 


-. 36 * 


.38 


.28 


.30 


. 46 * 


.23 


.07 


.20 


.12 


. 37 * 


.28 


. 44 * 


. 47 ' 


.03 


.10 


.02 


-.12 


-.06 


-.18 


-.18 


-.12 


.19 


-.29 


-. 54 * 


-.44 


-.12 


-.25 


-.36 


-.23 


-.20 


-.32 


.42 


-.44 


-.10 


-.24 


-.03 


-.01 


-.22 


-.12 


-.33 


-.29 


-.29 


-.19 


-.34 


-.21 


.13 


.15 


.07 


.18 


.16 


-.02 


.04 


.01 


.04 


.00 


.22 


.05 


.20 


.17 


. 31 * 


.16 


.12 


.08 


.03 


-.05 




. 75 * 


. 72 * 


. 71 * 






. 67 * 


.59* 








.78* 



♦Significant at .05 or above 
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Table 18 



Coefficients of Correlation Between Predictor Variables 
and Four Ratings of Performance - Group Two 



Predictor 

Variable 


Ability 
N to Learn 


Quanti ty 
of Work 


Qual i ty 
of Work 


Knowledge 
of Work 


Aqe 


14 


-.55* 


-.33 


-.54* 


-.57 


Education 


14 


-.57* 


-.54* 


-.50 


-.25 


X-0 Right 


4 


-.53 


.05 


.28 


-.32 


X-0 Wrong 


4 


.69 


.15 


-.07 


.26 


Right 


4 


.23 


.77 


.92 


-.48 


Wrong 


4 


.41 


-.30 


-.49 


.52 


X-0 $-^ Right 


4 


-.34 


.27 


.49 


-.39 


X-0 $-^ Wrong 


4 


.60 


.02 


-.24 


.37 


Matrices Right 


4 


.84 


.61 


.72 


.26 


Matrices Wrong 


4 


-.51 


.25 


.10 


-.92 


Book I A 


6 


.19 


.17 


-.22 


-.52 


Book I B 


6 


.83* 


.86* 


.66 


.28 


A & B Combined 


6 


.70 


.71 


.36 


-.08 


A & B Weighted 


6 


.70 


.71 


.36 


-.08 


Book II A 


10 


.43 


.22 


.33 


.20 


Book II B 


12 


.07 


.16 


.05 


-.19 


Total Raw Score 


12 


.08 


.14 


.22 


.23 


Converced Raw Score 


11 


.47 


.41 


.26 


.01 


Typing 


11 


.28 


.11 


.23 


.34 


Wri tten 


12 


.44 


.45 


.32 


-.31 


Oral Rating 


12 


-.67* 


-.15 


-.23 


-.83* 


Rounded Value 


11 


.44 


.32 


.16 


.02 


Ability to Learn 


14 




.73* 


.73* 


.82* 


Quantity of Work 


14 






.89* 


.44 


Quality of Work 


14 








. 55* 



♦Significant at .05 or above 
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Table 19 

Coefficients of Correlation Between Predictor Variables 
and Four Ratings of Performance - Group Three 



Predictor 

Variable 



Ability Quantity Quality Knowledge 
N to Learn of Work of Work of Work 



Age 

Education 

Book I A 

Book I B 

A & B Combined 

A & B Weighted 

Book II A 

Book II B 

Book II C 

Total Raw Score 

Converted Raw Score 

Typing 

Wri tten 

Oral Rating 

Rounded Value 

Ability to Learn 

Quantity of Work 

Quality of Work 



15 


-.01 


..26 


It 


-.12 


-.06 


5 


-.76 


-.87* 


5 


.34 


.05 


5 


-.52 


-.71 


5 


-.87* 


-.85 


14 


.14 


.08 


14 


.33 


.37 


10 


-.41 


-.31 


14 


.22 


.17 


14 


.21 


-.02 


14 


.18 


.44 


15 


.20 


-.01 


15 


.24 


.03 


14 


.43 


.14 



15 



70* 



-.01 

-.18 

-.71 

.44 

-.44 

-.86 

.25 

.52 

-.42 

.18 

.13 

.22 

.29 

.33 

.38 

.85* 

.80* 



.33 

-.20 

-.78 

.39 

-.52 

-.87* 

.07 

.45 

-.39 

.25 

.00 

.43 

.01 

.05 

.25 

.71* 

. 88 * 

.81* 



*Significant at .05 or above 
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Table 20 

Coefficients of Correlation Between Predictor Variables and 
Four Ratings of Performance - Group Four 



Predictor Ability Quantity Quality Knowledge 

Variable N to Learn of Work of Work of Work 



Age 17 
X-0 Right 18 
X-0 Wrong 18 
$-^ Right 18 
$-i Wrong 18 
X-0 $-^ Right 18 
X-0 $-i Wrong 18 
Visual Memory Right 18 
Visual Memory Wrong 18 
Matrices Right 18 
Matrices Wrong 18 
Length of Last Employment 17 
Salary of Last Employment 16 
Written 14 
Oral Rating 13 
Total Rounded 4 
Ability to Learn 18 
Quantity of Work 18 
Quality of Work 18 



.34 


.10 


.35 


.19 


.08 


.04 


.07 


.10 


.05 


.07 


.01 


-.26 


.10 


.31 


.10 


.23 


-.12 


-.26 


-.13 


-.27 


.10 


.15 


.09 


.17 


-.12 


-.19 


-.14 


-.33 


-.37 


-.39 


-.42 


-.26 


-.40 


-.24 


-.37 


-.44 


.20 


.14 


.12 


.12 


-.18 


-.37 


-.20 


-.37 


-.22 


-.18 


-.18 


.18 


.06 


-.09 


-.07 


-.41 


.17 


.19 


.14 


.06 


.00 


-.31 


.01 


-.36 


.72 


.77 


.72 


.16 




.73* 


.95* 


.82* 






.82* 


.69* 








.82* 



♦Significant at .05 or above 
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DISCUSSION 

Specific conclusions have been reached and soecific recommendations 
have been made throughout both phases of the present project. Rather 
than reiterating these specifics here, the findings will be integrated 
into the answers to the three broad questions to which the project 
was addressed. ■ The questions and answers follow. 

1. What differences in oerformance on selected jobs exist among 

> if 

three ethnic grouos in Colorado? 

In both the cross sectional phase of the project as well as the 
lonqitudina'l phase, no evidence of differences in job oerformance among 

9 

the three ethnic groups was found. This finding encompassed several jobs 
and several criteria of performance. 

2. What differences in performance on selection devices exist 
among the three ethnic groups studied? 

Although there were some exceptions and there was considerable over- 
lapping of distributions, the mean scores of Negroes and Spanish-surname 
personnel were lower than the mean for Whites on the paper-and-pencil 
tests administered in the present project. Although the scores on low 
verbal materials tended to be more similar for the three groups than 
the scores for highly verbal materials, the differences still existed. 

, Mean oral interview ratings, however, were much more comparable for the 
three groups studied. 

3. What differential relationships exist between performance on 
selection devices and oerformance on the job when employees in selected 
jobs are classified according to three ethnic groups? 
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Evidence from both the cross sectional phase and the longitudinal 
phase of the present project indicates that the relationship between 
predictor variables and job performance varies from one ethnic group 
to another. Both the location of the specific job in the hierarchy and 
the composition of the local labor force influence these intr-subqroup 
relationships, however. The importance of the role which these two 
factors play in influencing the relationship between selection devices 
and job performance cannot be overemphasized. 

Continuous research to assess (1) the requirements for success on 
the job, (2) the performance of subgroups of applicants on all selection 
devices used in employment, and (3) the composition of the labor force 
will be necessary to assure that selection devices are being used fairly . 
When this condition prevails the probability of employment parallels 
the probability of success on a job regardless of membership in any 
subgroup in the labor force. 
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APPENDICES 



CAREER SERVICE - CODE FOR SELECTION ANALYSIS . . 
STATE CIVIL SERVICE - CODE FOR SELECTION ANALYSIS 



Standard Deviations for Selected Characteristics of 
Tested and Hired Applicants by Ethnic Group - Hospital 
Attendant 

Interview Areas One, Two, Three and Four for Hospital 
Attendant Applicants 



CAREER SERVICE - CODE FOR SELECTION ANALYSIS 



Interval Size in ( ) 

Variable No. 





Columns 1, 2 and 3 
Employee I.D. Number 
001 - 999 


1 


Columns 4 and 5 (03) 
Age 
01-99 


2 


Column 6 

Ethnic Group 

1 - White 

2 - Negro 

3 - Spanish 


3 


Columns 7 and 8 (01) 

Education - Number of years completed 
01 - 99 


4 


Colum.;i 9 (01) 
Sex 

1 - Male 

2 - Female 


5 


Column 10 (01) 
Marital Status 

1 - Single 

2 - Married 

3 - Divorced 

4 - Separated 

5 - Widowed 


6 


Columns 11 and 12 (05) 

X-0 Score - Number Correct 
00 - 99 


7 


Columns 13 and 14 (05) 

X-0 Score - Number Wrong 
00-99 


8 


Columns 15 and 16 (05) 

X-0 Score - Number Attempted 
00 - 99 


9 


Columns 17 and 18 (05) 

$-^ Score - Number Correct 
00 - 99 


10 


Columns 19 and 20 (05) 

$-^ Score - Number Wrong 
00 - 99 
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Variable No. 



11 


Columns 21 and 22 (05) 

$-i Score - Number Attempted 
00 - 99 


12 


Columns 23 and 24 (05) 

X-0 and $-( - Total Score Correct 


13 


Columns 25 and 26 (03) 
SRA Score 
00 - 99 


14 


Columns 27 and 28 (05) 

X-0 and $-^ Total Score Attempted 
00-99 


15 


Columns 29 and 30 (05) 

Visual Memory Score - Number Correct 
00-99 


16 


Columns 31 and 32 (05) 

Visual Memory Score - Number Wrong 
00 - 99 


17 


Columns 33 and 34 (05) 

Visual Memory Sco*^ - Number Attempted 
00 - 99 


18 


Columns 35 and 36 (03) 

Matrices Score - Number Correct 
00 - 99 


19 


Columns 37 and 38 (03) 

Matrices Score - Number Wrong 
00 - 99 


20 


Columns 39 and 40 (03) 

Matrices Score - Number Attempted 
00 - 99 


21 


Column 41 (09) 

Health Related Experience 

1 - Yes 

2 - No 


22 


Column 42 (01) 

Interview Rating - Area #1 
1 - 0 

2- 5 

3- 10 




4- 15 

5- 20 
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Variable No. 



23 



24 



25 



26 



27 



28 



Column 43 (01) 

Interview Rating - Area 12 
1 - 0 

2- 5 

3- 10 

4- 15 

5- 20 

Column 44 (01) 

Interview Rating - Area #3 
1 - 0 

2- 5 

3- 10 
4 - 15 
5-20 

Coluiifi 45 (01) 

Interview Rating - A. ea #4 
1 - 0 

2- 5 

3- 10 

4- 15 

5 - 20 

Columns 46 and 47 (02) 

Total Interview Rating 
00-99 

ColuiPTi 48 (01) 

Basis of Application 

1 - Newspaper 

2 - Notice card 

3 - Job bulletin 

4 - City employee 

5 - Friend or relative 

6 - State employment 

7 - News article 

8 - Magazine 

Column 49 (01) 

Previously Employed by City 

1 - Yes 

2 - No 

Column 50 (01) 

Retired from City 

1 - Yes 

2 - No. 
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Variable 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

o 

ERIC 



No. 



Column 51 (01) 

Pass Other Exam 

1 - Yes 

2 - No 

Column 52 (01) 

Foreign Language 

1 - Yes 

2 - No 

Column 53 (01) 

Physical Disability 

1 - Yes 

2 - No 

Column 54 (01) 

Mental Illness 

1 - Yes 

2 No 

Column 55 (01 ) 

Veteran 

1 - Yes 

2 - No' 

Column 56 (01) 

Disability as Veteran 

1 - Yes 

2 - No 

Column 57 (01) 

Pay Attached Due to Indebtedness During Last Five Years 

1 - Yes 

2 - No 

Column 58 (01) 

Dismissed from Job 

1 - Yes 

2 - No 

Column 59 (01) 

Violated Law 

1 - Yes 

2 - No 

Column 60 (01) 

Contact Present Employer 

1 - Yes 

2 - Mo 
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Vari able 

40 

41 



42 

43 

44 

45 

46 
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No. 



Column 61 (01) 

Presently Eiioloyed 

1 - Yes 

2 - No 

Column 62 (01) 

Classification of Last Job 

1 - Health related 

2 - Unskilled labor 

3 - Agriculture 

4 - Food service area 

5 - Student 

6 - Service, non-food 

7 - Part time or volunteer 

Column 63 (01) 

Length of Last Job 

1 - Less than six months 

2 - Six to eleven months 

3 - Twelve to twenty- three months 

4 - Twenty- four to thirty- five months 

5 - More than thirty- five months 

Column 64 (01) 

Money Earned on Last Job 

1 - Si 50 to $199 oer month 

2 - $200 to $249 per month 

3 - $250 to $299 per month 

4 - $300 to $349 per month 

5 - More than $349 per month 

6 - Part time or volunteer 

Column 65 (01) 

Under-Over Employed on Last Job 

1 - Underemployed 

2 - Reasonable 

3 - Overemployed 

Column 66 (01) 

Classification of Next to Last Job 

1 - Health (45a) 

2 - Unskilled (45b) 

Column 67 

Length of Next to Last Job 
Same as column 63 

Column 68 

Money Earned on Next to Last Job 
Same as Column 64 



47 
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Vari able 



48 



55 



56 



5? 



49 



Column 69 (01) 

Length of time in Denver 

1 - Less than six months (48a) 

2 - Six to eleven months 

3 - Twelve to Twenty- three months 

4 - Twenty- four to thirty- five nwnths 

5 - Thirty-six months or over (48b) 

Colu.nn 70 

1 - Tested, no app. WITHDREW or DID NOT APPEAR 

2 - Tested and INTERVIEWED only 

3 - Tested, interviewed and LISTED only 

4 - Tested, interviewed, listed and CERTIFIED only 

5 - Tested, interviewed, listed> certified and VOLUNTARILY REFUSED 

6 - Tested, interviewed, listed, certified, HIRED ON FIRST INTERVIEW 

7 - Tested, interviewed, listed, certified, HIRED ON SECOND 



Column 
4 - 
2 - 

3 - 

4 - 

5 - 

6 - 

7 - 

8 - 



71 

Not hired 

Hired and did not show ud for 
Still on list 

Hired and worked more than 90 
Hired and worked more than 90 
Hired and worked more than 90 
Hired and worked LESS than 90 
Hired and worked LESS than 90 



work 

days HIGH 
days STANDARD 
days LOW 

days WOULD REHIRE 
days WOULD NOT REHIRE 



Column 72 

1 - Tested and WI1HDREW 

2 - DNA for interview at Career Service 

3 - DNQ on interview at Career Service 

4 - DNP on interview at Career Service 

5 - Not certified 

6 - DNA at hospital for interview - eliminated 

7 - DNH on first interview at hospital, DNA for second interview 

8 - DNH on first or second interviews at hospital 

9 - HIRED 

Column 73 (01) 

Quantity Rating 

1 - Unsatisfactory 

2 - Below Standard 

3 - Standard 

4 - Above Standard 

5 - Outstanding 

Column 74 (01) 

Quality Rating 
Same as Column 73 



50 



Variable 



51 Column 75 (01) 

Reporting Habits 
Same as Column 73 

52 Column 76 (01) 

Overall Rating 
Same as Column 73 

53 Column 77 (01) 

Supervisory Rating of Ability 
Same as Column 73 

54 Column 78 (01) 

Supervisory Rating of Performance 

Same as Column 73 



STATE CIVIL SERVICE - CODE FOR SELEaiON ANALYSIS 



Columns 1, 2 and 3 Column 

Identification Nuiriber Job 

1 - 

Column 4 2 - 

Ethnic Group 3 - 

1 - White 4 - 

2 - Negro 5 - 

3 - Spanish 6 - 

Variable No. 8 " 



1 

2 



3 



4 



5 

6 



7 



Columns 6 and 7 
Age 

Column 8 

Marital Status 

1 - Single 

2 - Married 

3 > Separated 

4 - Widowed 

5 - Divorced 

Column 9 
Sex 

1 - Female 

2 - Male 

Column 10 

Length of Residence in Colorado 

1 - More than 3 years 

2 - Two to three years 

3 - One to two years 

4 - Six to twelve months 

5 > Less than six months 

Columns 11 and 12 

Education (total years) 

Column 13 

Length of Last Employment 
- same as column 10 

Column 14 

Salary at Last Employment 

1 - Part time 6 - $350-399 

2 - $150-199 7 - $400-449 

3 - $200-249 8 - Over $449 

4 - $250-299 

5 - $300-349 



5 

Cl assifi cation 
Int. Clk. Typist 
Senior Clk. Typist 
Int. Clerk Steno. 
Senior Clk. Steno. 
Clerk Typist 
Clerk Steno. 

Die. Mach. Trans. 
Res. Sup. Trainee 



Variable No. 



Variable No. 



8 


Columns 15 and 16 
Book I -A 


25 


9 


Columns 17 and 18 
Book I-B 


26 


10 


Columns *19, 20, 21 
A & B Combined 


27 


11 


Columns 22, 23, 24 
A & B Weighted 


28 


12 


Columns 25 and 26 
Book II-A 


29 


13 


Columns 27 and 28 
Book I I-B 


30 


14 


Columns 29 and 30 
Book II-C 


31 


15 


Columns 31 and 32 
Book II-E 


32 


16 


Columns 33, 34, 35 


33 




Total Raw Score 


34 

35 


17 


Columns 36 and 37 
Converted Score 


36 


18 


Columns 38 and 39 
Typi ng 




19 


Columns 40 and 41 
Steno 




20 


Columns 42 and 43 
Wri tten 




21 


Columns 44 and 45 
Oral 




22 


Columns 46 and 47 
Total Rounded 




23 


Columns 48 and 49 
X-0 Right 




24 


Columns 50 and 51 
X-0 Wrong 





Coluims 52 and 53 
Right 

Columns 54 and 55 
$-4 Wrong 

Columns 56, 57, 58 
X-0 $-4 Right 

Columns 59 and 60 
X-0 $-4 Wrong 

Columns 61 and 62 
Visual Memory Right 

Columns 63 and 64 
Visual Memory Wrong 

Columns 65 and 66 
Matrices Right 



Columns 67 and 68 
Matrices Wrong 



Column 69 
Column 70 ^ 
Column 71 
Column 72 



Performance 



o 






INTERVIEWED 

F = 2.269 
(2,185) 



LISTED 

F = 2.266 
(2.84) 



CERTIFIED 

F = 0.825 
(2,146) 



HIRED 

F = 0.589 
(2,70) 



Interview Area One by Selection Stape 
and Ethnic Group 

HOSPITAL ATTENOANT 



X 

N 



1 TESI 


rED 


1 ^ 


w 


s 


T 


Is.s 

1 49 


4.5 

85 


4.5 

56 


5.0 

190 



F - 2.270 
(2,187) 



1 N 


W 


S 


T 


|5.5 
1 49 


4.5 

84 


4.5 

55 


5.0 

188 










w 


S 


T 


Is.s 

1 


4.5 

84 


4.5 

54 


s.o 

187 



1 N 


w 


S 


T 


15.5 

1 


5.0 

67 


s.o 

40 


s.o 

149 



I N 


w 


s 


T 


16.0 

1 


6.0 

37 


s.s 

19 


6.0 

73 






Worked More— Than 90 _ P ay_s . 




Low 



N 


W 


S 


T 



















N 


W 


s 


-1- 



















Withdrew 

Did Not Appear for 
Interview at C.S. 



Did Not Qualify 
Did Not Pass 



N 


W 


s 


T 


5.0 

7 


2.5 

17 


3.S 

14 


3.5 

38 



N 


W 


S 


T 


5.0 


4.0 


5.0 


4.9 


4 


10 


8 


22 


6.5 


5.0 


3.5 


s.o 


4 


6 


3 


13 


4.5 


3.5 


5.0 


4.0 


7 


6 


3 


16 


6.0 


4.0 


5.0 


s.o 


6 


5 


4 


15 


s.o 


0 


3.S 


3.5 


4 


-2- 







Not Certified 



Eliminated - DNA at 
Hospital for Interview 

Voluntarilv Refused 
After Certification 

Eliminated - Did Not Hire 
1st and DNA 2nd 

Rejected ~ DNH 1st and 
DNH 2nd 

Still On List 



N 


W 


S 


T 


15.0 

1 


6.5 

6 


5.0 

1 


5.0 

8 



Hired - Did Not Report 




N 


W 


S 


1 


5.0 

3 


5.5 

8 


25 .C 
5 


5.5 1 
16 1 



Urm1<1 T1 


•rked 
[phi r| 


Le.ss 

ER* ii 1 

? f 


Than 90 Days 
I Would Mot Rel 


, I 


N 


w 


S 


T I 


Q_ 


W 


S 


TJ 


5.5 

1 


6.5 

4 




l! 


ll 


5.5 

7 


5.0 

Z 


6.0 1 
liLA 
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Interview Area Two by Selection Stage 
and Ethnic Group 
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HOSPITAL ATTENDANT 



INTERVIEWED 

F = 2.072 
(2,185) 



LISTED 

F = 2.347 
(2,184) 



CERTIFIED 

F = 1.486 
(2,146) 



HIRED 



F = 0.954 
(2,70) 



X 

N 



1 TESl 


[ED 1 


1 ^ 


w 


S 


T 1 


16.5 
1 49 


7.0 

_8^ 


6.0 

56 


6.5 1 
190 1 



F = 1.960 
(2,187) 
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7.5 


8 .o{ 


17 


37 
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Withdrew 

Did Not Appear for 
Interview at C.S. 



Did Not Qualify 
Did Not Pass 
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14 
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3 
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Not Certified 



Eliminated - DNA at 
Hospital for Interview 

Voluntarily Refused 
After Certification 
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Rejected - DNH 1st and 
DNH 2nd 

Still On List 
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Interview Area Three by Selection Stage 
and Ethnic Group 

HOSPITAL ATTENDANT 



INTERVIEl>fED 

F = 0.368 
(2,185) 



LISTED 

F = 0.501 
(2.184) 



CERTIFIED 

F = 0.129 
(2,146) 



HIRED 

F = 0.183 
(2.70) 
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INTERVIEWED 

F = 0.362 
(2,185) 



LISTED 

F = 0.401 
(2.184) 
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(2.146) 



Interview Area Four by Selection Stage 
and Ethnic Group 
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Table 21 

Standard Deviations for Selected Characteristics of 
Tested and Hired Applicants by Ethnic Group 

HOSPITAL ATTENDANT 



Tested Hired 



Characteristic 


Negro 


Whi te 


Spanish 

Surname 


Negro 


Whi te 


Spanish 

Surname 


X-0 Score 


12.2 


10.8 


10.3 


8.7 


9.2 


11.3 


Score 


6.2 


O 

t 


5.4 


CSJ 

• 


3.5 


6.4 


X-0 $-^ Score 


17.3 


14.3 


14.5 


11.4 


10.4 


16.9 


SRA Score 


10.7 


8.6 


7.3 


12.1 


6.9 


8.6 


Visual Memory 
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15.2 
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14.8 
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